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Preface 


A  workshop  on  the  topic  "Future  Directions  for  Optical  Information  Processing"  was  held  on  May  20-22, 

1980  on  the  campus  of  Texas  Tech  University  in  Lubbock,  Texas.  The  workshop  was  sponsored  by  the  L'.S.  Army 
Research  Office  and  hosted  by  Texas  Tech's  Department  of  Electrical  Engineering.  The  goals  tf  the  workshop 
were  (1)  to  present  a  reasonably  comprehensive  overview  of  some  critical  research  areas  in  ov.tlcal  informa¬ 
tion  processing  and  (2)  to  discuss  which  potential  areas  for  future  research  appeared  most  attractive. 

With  these  goals  in  mind,  the  co-directors  put  together  a  program  of  ten  Invited  speakers  and  ten  dis¬ 
cussion  leaders.  Each  speaker  also  provided  a  manuscript  for  these  proceedings.  The  manuscripts  are  each 
followed  by  an  edited  transcript  of  the  discussion  which  followed  the  respective  talk.  Also  presented  is  an 
edited  transcript  of  the  summary  panel  discussion  which  concluded  the  workshop,  and  a  list  of  the  37  parti¬ 
cipants. 

A  high  degree  of  enthusiasm  characterized  the  presentations,  discussions,  and  the  panel  discussion.  It 
is  hoped  that  the  workshop  will  be  repeated,  possibly  at  two  year  intervals,  with  the  next  workshop  tentative¬ 
ly  scheduled  for  1983. 

The  co-directors  want  to  acknowledge  the  financial  support  provided  by  the  U.S.  Army  Research  Office, 
with  Drs.  William  A.  Sander  and  Bob  D.  Guenther  acting  as  contract  monitors.  The  support  and  assistance 
of  Dean  John  R.  Bradford  of  the  Texas  Tech  University  College  of  Engineering,  Dr.  Russell  H.  Seacat,  Chairman 
of  the  Department  of  Electrical  Engineering,  and  the  staff  and  students  who  assisted  with  the  workshop  ar¬ 
rangements  are  also  gratefully  acknowledged - 


John  F.  Ualkup 
Thomas  F.  Krlle 
Lubbock,  Texas 
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Space-Variant  Coherent  Ootical  Processing 
John  F.  Ualkup 

Department  of  Electrical  Engineering 
Texas  Tech  University 
Lubbock,  Texas  79409 

Abstract 

This  paper  reviews  the  state-of-the-art  in  techniques  for  performing  either  one-dimensional  (1-D)  or  two- 
dimensional  (2-D)  space-variant  operations  using  coherent  light.  Examples  are  presented  to  illustrate  the 
major  categories  of  processors.  Possible  future  directions  which  appear  promising  are  suggested  and  dis¬ 
cussed  . 

1.  Introduction 

Most  of  the  original  interest  in  coherent  optical  information  processing  centered  on  the  possibility  of 
doing  linear,  space-invariant  operations  (e.g.  convolutions,  correlations)  using  the  Fourier  transforming 
properties  of  converging  lenses  [l].  In  recent  years,  however,  more  attention  has  been  devoted  to  increasing 
the  flexibility  of  coherent  optical  processors[2-7].  In  particular,  considerable  attention  has  been  devoted 
to  techniques  for  performing  either  one-dimensional  (1-D)  or  two-dimensional  (2-D)  space-variant  operations 
described  by  the  1-D  and  2-D  superposition  integrals. 

To  illustrate,  in  the  1-D  case  the  superposition  integral  is  given  by 

g(x)-J  f(£)h(x;S)dS  (1) 

where  f(£)  represents  the  1-D  input  "signal,"  h(x;£)  represents  2-D  system  line  spread  function  or  impulse 
response,  and  g(x)  is  the  output.  When  the  response  h(x;£)  depends  only  on  x-4  Eq.(l)  becomes  the  familiar 
convolution  Integral , 

g(x)  -  J  f  (Dh(x-f)df  .  (2) 


In  the  2-D  input  case,  the  more  general  linear  space-variant  operation  is  described  by  the  superposition 
integral 


g(x,y)  *  JJ  f (S,h)h(x,y;£,n)d5  dh 


(3) 


where  f(£,n)  is  the  2-D  input  signal,  and  h(x,y;C,h)  is  now  (potentially)  a  4-D  point  spread  function  de¬ 
scribing  the  system  response  at  output  coordinates  (x,y)  to  a  point  source  (inpulse)  located  at  input  coordi¬ 
nates  (S,n).  Again,  in  the  special  case  of  a  space- invariant  system,  the  point  spread  function  becomes 
h(x-q,  y-n)  and  one  obtains  the  2-D  convolution  integral 


(4) 


g(x,y)  •  f(£,n)h(x-£,  y-n)  d£  dn 

_£0 

characteristic  of  a  space-invariant  system. 

A  number  of  recent  review  papers  and  book  chapters  [2-7]  have  discussed  developments  in  coherent  space- 
variant  optical  processing  and  the  applications  of  these  techniques  in  problem  areas  such  as  image  restora¬ 
tion,  performing  various  integral  transforms  in  pattern  recognition  applications,  various  frequency-variant 
operations  [s],  and  others.  One  of  the  prime  motivations  for  studying  techniques  for  optically  evaluating 
Eqs.  (1)  and  (3)  is  that  in  contrast  to  many  temporal  signal  analysis  problems  where  the  systems  of  Interest 
may  be  time- invariant,  a  broad  variety  of  optical  systems  and  optical  processing  operations  are  space- 
variant,  Including  the  familiar  Fourier  transforming  and  non-unity  magnification  systems.  It  should  also  be 
noted  that  while  only  coherent  processors  will  be  discussed  here,  incoherent  processors  capable  of  performing 
space-variant  matrix-vector  multiplication  operations  on  either  serial  [9]  or  parallel  [ 10]  data  are  also 
being  actively  investigated. 

2.  Techniques  for  Space-Variant  Processing 

We  will  group  the  techniques  to  be  discussed  into  four  categories:  (1)  techniques  for  1-D  Inputs; 

(2)  holographic  multiplexing  techniques;  (3)  coordinate  transformation  processing  techniques;  and  (4)  other 
novel  techniques. 


2.1  Techniques  fot  1-D  Inputs 


It  has  been  shown  [ll,12],  based  on  earlier  work  by  Cutrona  [ 13]  chat  the  processor  of  Figure  1  will 
perform  a  generalized  1-D  space-variant  operation  of  the  form  of  Eq.  (1).  As  shown  the  1-D  Input  f(5)  Is 
coherently  illuminated  and  placed  adjacent  to  the  2-D  processing  mask  representing  the  potentially  complex 
kernel  h(x,5).  An  astigmatic  operation  [l4]  consisting  of  Fourier  transforming  along  the  £  axis  and  imaging 
along  the  x  axis  Is  performed  between  planes  P,  and  P,  by  the  3  cylindrical  lenses  L.  ,  L-,  and  L,  (focal 
lengths  related  by  2f^  •  f^  «  2fj).  In  the  output  plane  Pj,  the  field  amplitude  g  (i,v)^is  given  by 


gQ(x,v)  -  f  (5)h(x;5)exp(-j2irv5)d?  (5) 

■maa 

with  v  -  x/>f.  being  the  scaled  spatial  frequency.  Looking  along  the  v»0  axis  we  find  that,  comparing  with 

Eq.  (1), 

gQ(x,  0)  -  g (x) ,  (6) 

which  indicates  that  the  processor  of  Fig.  1  can,  in  principle,  perform  a  broad  range  of  1-D  space-variant 
operations.  Examples  of  the  types  of  operations  which  can  be  performed  with  the  1-D  space-variant  processor 
are  numerous.  They  include  variable  spatial  magnification  [ll,12],  geometrical  distortions  (coordinate  trans¬ 
formations)  [4,11,12],  and  Mellln  transforms[3, 15-19] .  Variations  of  this  processor  have  also  been  used  to 
perform  operations  such  as  frequency-variant  spectral  analysis[8].  In  addition,  the  astigmatic  lens  opera¬ 
tion  may  actually  be  combined  with  the  h(x;€)  function  to  produce  a  "single  optical  element"  processor 
consisting  of  a  1-D  input,  a  processor  mask,  and  a  region  of  free  space  before  the  output  plane,  which  indi¬ 
cates  some  of  the  power  in  the  processor.  The  introduction  of  1-D  time  signals  using  acousto-optical  devices 
offers  opportunities  far  real-time  processing  subject  to  device- imposed  constraints. 

Before  leaving  the  processor  of  Figure  1  it  is  well  to  note  chat  if  one  makes  use  of  the  entire  output 
plane  rather  than  only  the  o*0  axis,  the  processor  may  be  used  to  evaluate  such  2-D  functions  of  a  1-D  input 
as  the  Laplace  transform  [2l]  and  the  familiar  Woodward  radar  ambiguity  function  [22-25],  Though  these  func¬ 
tions  are  not,  strictly  speaking,  space-variant  1-D  operations  based  on  the  definition  of  Eq.  (1),[26]  they 
bear  mentioning  due  to  the  fact  chat  they  represent  operations  of  significant  interest  to  the  optical  infor¬ 
mation  processing  comnunity. 

Potentially  attractive  future  directions  in  Che  area  of  1-D  space-variant  processing  include  (1)  Che 
continued  investigation  of  real  time  operations  using  acousto-optical  devices;  (2)  exploring  further  the  use 
of  computer-generated  holographic  masks  (CGH's)  to  represent  h(x;£)  for  a  variety  of  integral  transforms  and 
other  processing  operations;  and  (3)  investigating  the  use  of  1-D  processors  plus  time-integrating  detectors 
to  perform  2-D  space-variant  operations  of  the  form  of  Eq.  (3).  It  is  clear  that  the  class  of  1-D  space- 
variant  operations  which  should  be  performable  is  almost  certainly  much  larger  than  has  been  explored  to 
date . 


2.2  Holographic  Multiplexing  Techniques 

When  we  move  from  1-D  space-variant  processors  to  the  2-D  processors  described  in  Eq.  (3),  new  approach¬ 
es  oust  be  considered.  The  problem  is  that  h(x,y;5,h)  may,  in  principle,  be  a  different  function  of  (x,y) 
for  each  Input  point  (E,h).  One  potentially  attractive  class  of  approaches  is  to  multiplex  holograms  de¬ 
scribing  the  responses  of  the  space-variant  system  to  various  inputs.  At  Texas  Tech  University  we  have  been 
considering  three  such  multiplexed  hologram  approaches:  (1)  a  sampling  theorem-based  approach;  (2)  a  piece- 
wise  isoplanatic  approximation  (PIA)-based  approach;  and  (3)  a  discrete  orthonormsl  basis  set  approach. 

The  sampling  theorem-based  approach  makes  use  of  a  modification,  for  space-variant  systems ,  of  the 
familiar  Whlttaker-Shannon  sampling  theorem  [27,28],  We  assume  that  h(x,y;£,n)  varies  in  a  bandllmited 
nanner  as  a  function  of  (x,y)  for  variations  in  the  Input  coordinates  (C,n).  The  modified  sampling  theorem 
states  that  the  system's  output  can  be  perfectly  reconstructed  (in  the  absence  of  noise)  by  sampling  the 
input  plane  at  a  rate  proportional  to  the  sum  of  the  Input's  bandwidth  and  a  "variation  bandwidth"  which 
characterizes  how  rapidly  h(x,y;5,n)  changes  with  %  and  q.  For  space-invariant  systems  this  variation  band¬ 
width  goes  to  zero  as  expected. 

Another  multiplexed  hologram  approach,  the  PIA  approach  [29-31]  would  store  only  one  hologram  per  iso¬ 
planatic  patch,  and  would  thus,  In  principle,  be  input  bandwidth- Independent  as  far  as  the  number  of  stored 
holograms  required.  The  third  approach  mentioned  -  l.e.  the  discrete  orthonormal  basis  set  approach  -  would 
store. the  system's  responses  to  each  element  of  an  orthonormal  basis  set  spanning  the  space  of  possible  In¬ 
puts  129,314.  Here  the  number  of  stored  holograms  would  be  system-independent  but  would  be  input-dependent. 
To  date  the  approach  investigated  in  most  detail  has  been  the  sampling  theorem-based  approach. 

Figure  2  illustrates  the  basic  idea  behind  the  sampling  theorem-based  approach.  The  input  plane  is  co¬ 
herently  illuminated  and  spatially  sampled.  After  a  Fourier  transforming  operation  by  lens  L^,  the  many 
plane  waves  associated  with  different  input  plane  samples  access  holographic  filters  multiplexed  in  the 
single  holographic  medium  shown  placed  in  the  Fourier  plane.  We  assume  that  each  filter  is  accessed  so  that 
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crosstalk  with  other  filters  is  suppressed.  Then,  assuming  coherent  addition  of  waves  in  the  output  plane 
after  another  Fourier  transforming  operation  by  lens  L^,  the  output  will  closely  approximate  the  desired  out- 
put-i.e.  a  discrete  approximation  to  the  superposition  integral  of  Eq.  (3).  The  approach  of  Fig.  2  is  at¬ 
tractive  since  in  principle,  the  space-bandwidth  product  of  the  processor  is  limited  only  by  our  ability  to 
holographically  multiplex  the  filters. 

An  early  approach  to  suppressing  hologram-to-hologram  crosstalk  in  the  sampling  theorem-based  approach 
was  to  employ  the  Bragg  extinction  angle  condition  associated  with  thick  recording  media  [32].  Unfortunately 
Che  Bragg  phenomenon  is  not  nearly  as  effective  in  suppressing  crosstalk  when  sampling  2-D  inputs  as  it  is 
in  sampling  1-D  inputs. 

A  more  attractive  approach  to  the  multiplexed  hologram  processor  involves  the  use  of  phase-coded  refer¬ 
ence  beams  [33-3&].  An  advantage  of  this  approach  is  that  thin  recording  media  may  be  used,  although  addi¬ 
tional  crosstalk  suppression  may  be  had  using  thick  media.  The  setups  for  recording  and  playing  back  a  multi¬ 
plexed  hologram  processor  for  multiple  phase-coded  reference  beams  are  indicated  in  Figs.  3  and  4.  As  shown 
in  Fig.  3,  one  r^gords  the  multiplexed  processor  by  sampling  the  sp^e-variant  system's  input 
plane  with  the  i  ^sample  producing  point  spread  function  h  .  The  i  reference  point  source  simultaneously 
illuminates  the  i  member  of  a  family  of  n  phase-encoding  diffusers  (e.g.  shower  glass,  ground  glass,  binary¬ 
valued  Gold  code  masks,  etc.).  Lenses  L.  and  perform  Fourier  transform  operations,  producing  sequentially 
recorded  holograms  of  the  m  respective  transfer  functions  of  the  space-variant  system,  with  each  reference 
beam  uniquely  phase-encoded.  When  one  simultaneously  plays  back  all  n  holograms,  as  in  Fig.  4,  by  spatially 
sampling  an  input  s,  the  output  0  is  mathematically  described  by 

n  n  n  „ 

°*  S'  a  h  *  (M  )  +  l  1  S.  h  *  (H*}1  )  (7) 

i«l  i-1  j-1  ->  1  J 

.  Hi 

where  *  represents  convolution  and  jf  represents  correlation.  Since  the  ideal  output  is  given  by 

n 

o  "  l  s  h-  (8) 

i-1 

it  is  clear  that  we  seek  a  family  of  "effective "diffuser  functions  (the  products  of  the  transmittances  of 
t(je  diffusers  and  the  complex  amplitudes  of  the  illuminating  waves)  such  that  all  the,autocorrelations 
(M1J^M1)  are  essentially  Dirac  delta  functions,  and  all  the  crosscorrelations  )  are  essentially 

zero .  ^ 

To  illustrate  the  discussion  just  presented.  Figure  5  shows  the  output  of  a  multiplexed  holographic 
processor  representing  a  1.5x  magnifier  for  a  2x2  input  array,  with  each  diffuser  (ground  glass)  section 
illuminated  with  a  plane  wave  [35,37].  The  n(n-l)  •  4(3)  »  12  crosstalk  terms  have  been  distributed  into  the 
noise-"balls"  surrounding  each  of  the  desired  n-4  output  points.  Figure  6  illustrates  the  fact  that  "chirp¬ 
ing"  the  diffusers  by  illuminating  them  with  spherical  wavefronts  rather  than  plane  wavefronts  produce  "effec¬ 
tive"  diffusers  which  are  superior  to  those  produced  by  plane  wave  Illumination  [34-37]. 

Figure  7  shows  the  optical  output  of  a  badly  distorted  magnifier  designed  to  blur  each  of  13  input 
points  in  a  different  manner  (clearly  space-variant).  Figure  8  then  shows  the  output  of  the  holographic 
processor  designed  to  replace  the  system  which  produced  the  output  of  Fig.  7.  Here  we  accessed  13  holograms 
in  a  stored  array  (5x5)  of  25  holograms,  with  "chirped"  illumination  being  used.  The  diffuse  crosstalk  is 
clearly  visible,  as  are  the  effects  of  vignetting  (fact  that  some  of  the  "tips"  of  the  "H"  are  missing). 

Recent  analytical  work  [36]  has  shown  that  binary  (2-level)  phase  diffusers  can,  in  principle,  perform 
as  well  as  multi-level  phase  diffusers  as  long  as  all  allowable  phase  levels  are  equiprobable .  Other  work 
has  shown  the  value  of  computer-multiplexed  holograms  in  permitting  one  to  avoid  the  bias  buildup  problems 
associated  with  the  direct  recording  of  n  multiplexed  holograms  [36].  Preliminary  results,  using  multiplexed, 
coded  computer  generated  holograms  for  space-variant  processing,  and  in  matched  filtering  for  pattern  recog¬ 
nition  [39],  have  been  encouraging,  though  more  work  is  needed  to  fully  explore  this  class  of  techniques. 

An  alternative  approach  to  multiplexing  holograms  for  the  purpose  of  space-variant  processing  is  based 
on  sampling  both  the  system's  input  plane  and  the  Fourier  plane,  as  shown  in  Fig.  9  [40].  Here  we  assume  the 
system  point  spread  functions  to  be  approximately  space-limited  in  addition  to  the  earlier  assumption  that 
the  input  plane  is  spatially  sampled.  This  additional  assumption  permits  one  to  sequentially  spatially 
sample  the  respective  transfer  functions  using  a  movable  binary  mask  with  periodic  openings,  as  shown  in 
Fig.  9.  The  playback  setup  is  indicated  in  Fig.  10.  The  clear  advantages  of  this  technique  over  the  tech¬ 
nique  described  earlier  in  Figs.  3  and  4  are  that  (1)  only  one  reference  beam  needs  to  be  used  and  (2)  there 
is,  in  principle,  zero  crosstalk  on  playback  due  to  the  fact  that  the  Fourier  plane  samples  are  spatially 
nonoverlapping.  The  disadvantage  lies  in  the  fact  that,  as  shown  in  Fig.  10,  the  input  function  must  be 
sampled  and  replicated  spatially  (l.e.  a  multiple  input  function  transparency,  etc.)  on  playback. 

Figures  11  and  12  illustrate  the  results  of  an  experiment  designed  to  test  the  concept  [40].  Nonoverlap¬ 
ping  impulse  responses  h.,  ...,  h,  are  shown  along  with  their  sum.  A  composite  computer-generated  hologram 
(CGH)  corresponding  to  the  sampled  transfer  functions  corresponding  to  h,,  ....  h4  was  generated  and  played 
back,  with  the  experimental  result  shown  in  Fig.  12.  It  was  also  shown  that  individual  point  spread  func¬ 
tions  could  be  accessed,  and  that  the  technique  is  not  limited  to  nonoverlapping  point  spread  functions. 

The  fact  that  coherent  addition  is  taking  place  was  verified.  A  method  for  reducing  quantization  errors  in 
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generating  computer-multiplexed  holograms  by  premultiplying  the  point-spread  function  by  a  binary  "checker¬ 
board"  phase  function  was  also  investigated  in  conjunction  vlth  this  technique. 

2.3  Coordinate  Transformation  Processing  Techniques 

This  is  one  area  where  earlier  developments  in  space-variant  digital  image  processing  [41,42]  stimulated 
related  work  in  coherent  optical  processing.  Several  approaches  have  been  investigated.  One  class  is  de¬ 
scribed  in  block  diagram  form  in  Figure  13.  Assigning  a  2-D  input Af (£,n) ,  the  first  step  is  to  perform  an 
Invertible  coordinate  transformation  to  yield  the  new  function  F(£,ft).  Next  one  performs  a  linear  space- 
invariant  filtering  operation  on  f(£,n)  to  yield  the  function  g(x,y).  The  second  coordinate  transformation 
is  the  inverse  of  the  first,  and  produces  the  processed  output  g(x,y).  The  Abel  transform  [15],  which  arises 
when  circularly  symmetrical  distributions  in  two  dimensions  are  projected  in  one  dimension  is  one  example  of 
a  space-variant  processing  operation  which  may  be  performed  as  indicated  in  Fig.  13. 

A  second  type  of  space-variant  coordinate  t rang forma^iqn^procea sing  technique  la  shown  in  Figure  14. 

Here  the  input  f(£,n)  is  coordinate-transformed  to  yield  f (£,  n) .  This  initial  coordinate  transformation  is 
chosen  to  enable  one  to  produce  the  desired  output  g(x,y)  using  a  simpler,  or  more  easily  performable  space- 
variant  filtering  operation.  A  well-researched  example  is  the  complex  Mellln  transform  [3,6,19]  where,  by 
taking  the  natur'.l  logarithms  of  the  input  coordinates,  one  is  able  to  then  obtain  the  Mellin  transform  by 
taking  a  simple  Fourier  transform  of  the  coordinate-transformed  input  function.  Though  the  Fourier  trans¬ 
form  is  still  a  space-variant  operation,  it  is  a  straightforward  one  to  obtain.  Caeesent  and  his  colleagues 
have  used  the  Mellln  transform  to  perform  scale-invariant  coherent  pattern  recognition,  along  with  a  number 
of  other  applications  [16,17,43-48], 

A  final  approach  worth  mentioning  here  is  the  use  of  phase  plates  or  computer-generated  holograms  (CGH's) 
to  produce  a  spatially-varying  coordinate  transformation.  This  approach  is  based  on  a  ray-optics  theory  of 
the  simultaneous  control  of  the  position  and  direction  of  rays.  This  technique,  due  to  Bryngdahl  [49],  is 
described  in  detail  in  several  references.  The  CGH  acts  as  a  generalized  grating,  with  the  grating's  spatial 
frequency  being  a  function  of  the  input  coordlnates-hence  the  space-variant  action.  The  technique  is  limited 
by  the  requirement  that  the  input  data  must  be  spatially  coarse  when  compared  to  the  structure  of  the  phase 
plate  or  CGH.  This  limits  the  space-bandwidth  product  of  optical  processors  designed  using  the  technique  for 
coordinate  transformation  processing.  The  reader  is  referred  to  a  recent  book  chapter  by  W.  H.  Lee  [50]  for 
a  review  of  this  and  other  optical  processing  applications  of  CGH's. 

2.4  Other  Hovel  Techniques 

The  techniques  described  above  do  not,  by  any  means,  exhaust  all  possibilities  for  performing  coherent 
space-variant  processing.  Carlson  and  Francois  [51,52]  have  shown  that  an  N+l  plane  processor  consisting  of 
alternating  multiplicative  operations  and  2-D  Fourier  transforming  operations  can  perform  a  variety  of  linear 
operations,  including  space-variant  operations.  This  processor  is  sketched  in  Figure  IS. 

The  optical  setup  for  a  polychromatic  space-variant  processor  is  shown  in  Figure  16  and  is  being  investi¬ 
gated  by  Strand  and  Sawchuk  [53].  A  polychromatic  collimated  source  illuminates  an  input  plane  transparency. 

A  color-multiplexed  spatial  filter  is  placed  in  the  Fourier  plane.  Each  filter  affects  a  different  wave¬ 
length  region  of  the  illumination.  In  the  output  plane  one  places  a  second  color  mask  which  can  select  any 
one  or  a  combination  of  the  spatially  filtered  outputs  at  each  point  of  the  output  plane.  This  output  mask 
then  determines  the  nature  of  the  system's  space-variant  characteristic.  Alternatively,  a  color-encoding 
mask  can  be  placed  adjacent  to  the  object  in  che  input  plane.  Figure  17(b)  Illustrates  the  results  obtained 
when  the  word  "SPACE"  in  17(a)  was  coded  red  and  low-pass  filtered,  whereas  the  word  "VARIANT"  vae  coded  blue 
and  high-pass  filtered.  An  advantage  of  this  technique  is  the  fact  that  it  imposes  no  severe  restrictions  on 
the  space-bandwidth  product  of  the  input. 

A  novel  technique  using  volume-hologram  multiplexed  filters  has  recently  been  suggested  by  Case  [54] 
based  on  earlier  work  by  Frlesem  and  Perl  [55].  As  shown  in  Figure  18  an  input  object  0  is  coherently  illu¬ 
minated,  with  a  volume  hologram  filter  F  placed  directly  behind  che  input  plane.  The  lens  L  Images  the 
transmitted  light  onto  che  image  plane  I.  Since  the  higher  spatial  frequency  components  of  the  input  0  ave 
diffracted  at  larger  angles  than  lower  spatial  frequency  information,  and  since  many  holograms  could  be 
multiplexed  spatially  in  che  medium  using  the  Bragg  extinction  angle  phenomenon  discussed  earlier,  definite 
possibilities  exlsc  for  using  this  input  plane  Fourier  processing  scheme  to  do  space-variant  processing. 

Again  we  expect  that  the  limitations  on  our  space-bandwidth  processing  capability  will  be  set  by  the  practi¬ 
cal  limitations  associated  with  scoring  angle-multiplexed  holograms  in  a  thick  recording  medium,  but  the 
technique  appears  worthy  of  additional  investigation. 

The  final  novel  technique  we'll  mention  might  be  referred  to  using  the  term  "temporal  holography."  It 
makes  use  of  the  temporal  integrating  and  summing  properties  of  a  hologram  [56,57],  As  a  result,  when  the 
hologram  is  played  back,  information  concerning  che  time  integral  of  the  amplitude  and  phase  variations  of 
an  object  wave  may  be  recovered.  As  Indicated  in  Figure  19,  a  2-D  spatial  light  modulator  has  been  replaced 
by  a  scanning  beam  [57]  which  is  temporally  amplitude-and/or  phase-modulated.  The  linear  optical  processor 
(possibly  space-variant)  processes  the  scanned  input  and  the  recording  medium  records  a  hologram  of  the 
scanned  input  and  the  reference  beam  shown.  On  playback,  as  shown  in  Figure  20,  one  of  the  terms  is  propor¬ 
tional  to  the  time-integral  of  the  product  of  the  scanning  input  and  the  point-spread  function  of  the  linear 
processor.  The  low  pass  filtering  in  the  v-direction  [57],  based  on  the  sampling  theorem,  acts  to  produce  a 


.  v 


better  approximation  to  the  desired  system  output.  It  has  been  shown  that  this  approach  permits  one  to  real¬ 
ize  a  discrete  approximation  to  the  superposition  integral  [56,57], 

Figure  21  indicates  how  one  could,  in  principle,  use  temporal  holography  to  do  space-variant  coherent 
processing  based  on  sampling  the  input  plane  of  a  processor  [56].  If,  for  the  nmC  input  sample  (i.e.  the 
sample  located  at  (£n,  nm)  as  shown)  we  introduce  the  8nm(fx,fv)  transfer  function  in  the  Fourier  plane, 
then  we  will  record  a  temporal  hologram  containing  the  superposition  of  the  oroduct  of  each  input  and  its 
respective  point  spread  function.  One  potential  advantage  to  this  temporal-holography  approach  to  space- 
variant  processing  is  that  the  processor  to  be  represented  need  not  be  physically  realizable  (i.e.  we  only 
need  to  have  the  collection  of  H  (f  ,f  )  masks  desired).  Potential  disadvantages  include  the  need  for 
sequential  data  inputs,  and  the  nledxto^change  the  Fourier  plane  "masks1'  for  each  input  sample.  V)e  note, 
however,  that  the  piecewise  isoplanatic  approximation  approach  and  the  discrete  orthonormal  basis  set  ap¬ 
proach  could  also  be  applied  here,  and  these  might  reduce  the  number  of  required  "masks." 

3.  Space-Variant  Processing:  Future  Directions 

It  is  clear  that  the  many  applications  for  space-variant  optical  processors  are  sufficient  to  stimulate 
research  interests  in  the  field  for  some  time  to  come.  Areas  needing  additional  work  include  (a)  the  need 
to  increase  the  space-bandwidth  products  of  the  processors;  (b)  the  need  to  handle  Inputs  and  processing  in 
real  time;  and  (c)  the  need  to  use  the  well  understood  1-D  space-variant  processing  systems  more  widely, 
possibly  including  their  use  in  2-D  processors.  In  addition,  from  some  of  the  recent  work  in  incoherent  op¬ 
tical  processing,  the  area  of  Incoherent  space-variant  processors  using  multiple  parameters,  including  color 
and/or  polarization  to  perform  operations  on  real  and  complex  inputs  appears  to  be  an  attractive  one  for 
future  work. 
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Fig.  1.  A  coherent  optical  processor  for  performing 
1-D  space-variant  operations  (Ref.  12). 


Fig.  2.  Basic  idea  for  2-0  space-variant  proces¬ 
sor  using  holographically  multiplexed 
filters  in  the  Fourier  plane  of  a 
coherent  processor. 


Fig.  3.  Setup  for  sequentially  recording  n  multiplex¬ 
ed  holograms  using  n  phase-coded  reference 
beams  (Ref.  34). 


Fig.  4.  Setup  for  playback  of  the  multiplexed 

holographic  processor  of  Fig.  3  (Ref.  34). 


9 


I 


» 


) 


t  - 


Fig.  5.  Output  of  holographic  processor  for  2x2  input 
array,  1 . 5x  magnifier,  ground  glass  diffuser 
and  plane-wavefront  diffuser  illumination 
(Refs.  35,37). 


Fig.  6.  Outout  of  processor  analogous  to  that 

of  Fig.  5,  but  using  spherical  wavefront 
("chirped")  diffuser  illumination 
(Refs.  35,37). 
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Fig.  7.  Optical  output  of  a  badly  distorted  raangifier 
for  the  13  Input  points  shaped  like  the 
letter  "H"  (Refs.  35,37). 
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Fig.  8.  Output  of  the  holograohic  processor 

designed  to  replace  the  system  used  to 
produce  Figure  7  (Refs.  35,37). 


Fig.  i3.  The  general  form  for  one  coordinate  transformation 
approach  to  obtaining  a  space-variant  processor. 


Fig.  14.  A  second  type  of  coordinate  transformation  processor. 
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Fig.  15.  An  N+l  plane  generalized  linear  coherent  processor  (Refs.  51,52). 
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Fig.  16.  Scheme  for  performing  space-variant  proc¬ 
essing  using  polychromatic  light  (Ref.  53). 
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Fig.  17.  Space-variant  processing  using  the  setup  of 
Figure  16.  Here  (a)  is  the  input  object  and 
(b)  is  the  output.  The  upper  word  has  been 
low-pass  filtered  and  the  lower  word  has 
simultaneously  been  high-pass  filtered 
(Ref.  53). 
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Fig.  18.  Technique  for  space-variant  processing 
using  a  multiplexed  volume  hologram 
processor  In  the  object  plane  (Ref.  54). 


Fig.  19.  Input  scanning  technique 

for  recording  a  hologram  of 
the  temporally  modulated 
scanning  beam  processed  by 
a  linear  processor  (pos¬ 
sibly  space-variant) . 

(Ref.  57) 


Fig.  20.  Scheme  for  playing  back  the 
hologram  recorded  In  Fig.  19 
(Ref.  57). 


Fig.  21.  Sampling  theorem-based  approach  for 
using  temporal  holography  to  perform 
a  2-D  space-variant  processing 
operation  (Ref.  56). 
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Discussion  (John  F.  Walkup;  Discussion  Leader:  Robert  J.  Marks  II) 

[key:  Q  «  Question,  a  ■  Answer,  C  ■  Comment,  and  R  *  Response.] 

Note:  A  review  article  by  Dr.  Walkup  covering  some  of  this  material  appears  in  the  May /June  1930  issue  of 

Opcical  Engineering. 

C.  There  has  been  a  lot  of  emphasis  on  space-variant  processing  looking  for  general  solutions,  and  it  seems 
to  ne  that  frequently  where  general  solutions  are  necessary,  the  systems  have  to  adapt  to  different  inputs. 

A  good  example  is  space-variant  noise  reduction  where  you  have  signal  dependent  noise.  In  a  certain  sense 
you  have  to  know  what  your  signal  is  before  you  car.  design  your  processor,  so  general  solutions  may  present 
a  particularly  difficult  problem.  The  adaptive  nature  of  optical  systems  is  an  area  of  considerable  diffi¬ 
culty  at  this  time.  Perhaps  the  rewards  would  be  as  great  for  looking  for  solutions  to  specific  situations 
where  the  space-variance  is  well  known  as  in  looking  for  a  general  processor  which  will  handle  those  speci¬ 
fic  situations. 

R.  That's  a  good  point.  There  may  also  he  some  profit  in  cataloging  the  number  of  specific  situations  you 
can  get  solutions  for,  and  then  seeing  if  mere's  any  way  to  generalize  some  of  them. 

C.  Generalized  processor  schemes  tend  to  water  things  down,  and  there's  the  potential  of  losing  some  of  the 
processing  power  by  doing  that. 

R.  In  the  1-D  case,  a  general  solution  exists.  The  system  Dr.  Goodman  will  tall:  about  later  can  do  arbi¬ 
trary  1-D  space-variant  relations. 

C.  That's  why  I'm  intrigued  about  exploiting  the  1-D  processor,  especially  for  2-D  operations,  because  we 
can  do  the  1-D  well. 

Q.  Is  the  1-D  processor  going  to  have  the  potential  to  compete  with  digital  processors?  If  you  take  a  1-D 
space-variant  operation  and  digitize  it,  you  get  a  matrix-vector  multiplier,  and  that  seems  to  be  a  thing 
that  could  be  done  very  quickly  digitally. 

A.  I  think  Joe  Goodman  will  talk  about  that,  along  with  Keith  Bromley's  work.  I  was  really  impressed  with 
that  because,  with  discrete  inputs,  he  can  do  a  space-variant  operation. 

C.  A  point  of  nomenclature:  a  space-variant  system  that  adapts  to  a  particular  signal  is  actually  a  non¬ 
linear  processor,  it's  no  longer  a  space-variant  linear  processor. 

C.  You  mentioned  that  the  volume  hologram  approach  has  the  disadvantage  of  responding  to  an  entire  cone  of 
angles  when  you'd  like  it  to  respond  to  just  one  point.  Also,  the  phase-codes  multiplexing  technique  has  a 
buildup  of  background  noise  "halo."  Perhaps  there's  fruitful  work  to  be  done  in  combining  these  two  ap¬ 
proaches. 

R,  When  Mike  Jones  was  working  in  our  group,  he  noticed  some  volume  effects  helping  him  out  when  he  went  to 
thicker  media  in  the  phase-coded  approach,  so  I  think  you're  right. 

C.  You  may  buy  something  good  by  using  the  1-D  angular  selectivity  of  a  volume  hologram  in  one  dimension 
and  then  a  1-D  diffuser  in  the  other  dimension. 

C.  When  you  talk  about  separable  kernels  to  do  2-D  operations  with  1-D  processors,  there  are  a  great  many 
transforms  that  are  of  practical  interest  and  are  space-variant,  such  as  the  Ualsh-Hadamard  transform. 

R.  I  agree.  At  first  it  seemed  to  us  as  if  the  inputs  had  to  be  separable  as  well,  and  that  would  be 
pretty  restrictive.  But  there  are  a  lot  of  situations  of  interest  with  separable  kernels. 

C.  Casasent  and  Psaltis  have  an  interesting  paper  in  the  last  issue  of  Optical  Engineering  on  different 
architectures  for  optical  processing,  including  space-variant  processing.  * 

C.  Just  as  an  aside,  the  angular  selectivity  of  volume  holograms  in  one  direction  and  the  lack  of  it  in  the 
orthogonal  direction  can  be  a  big  advantage  where  you  want  to  have  multiple  beams  accessing  the  hologram. 

Q.  What  are  some  of  the  more  important  applications  people  have  in  mind  for  2-D  space-variant  processors? 

A.  Restoration  of  blurred  Images  where  you  have  a  space-variant  blur,  such  as  panning  cameras,  is  one 

motivation. 

Q.  Is  this  a  continuing  problem  in,  say,  aerial  imaging? 

A.  Not  in  the  better  systems,  but  I'm  sure  there  are  other  applications  for  blur  removal  or  transform  mod¬ 
ification. 

C.  In  many  vehicles  they  have  unusually  shaped  windows  in  order  to  fit  the  window  to  the  vehicle,  and  they 
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don’t  have  circular  symmetry. 

Q.  Don't  you  have  to  talk  about  real-time  processing  there? 

R.  Yes,  you  have  co  calk  about  chat  all  Che  time. 

Q.  In  these  systems  which  work  in  the  lab  environment  we're  processing  images  having  only  a  few  resolution 

cells,  typically  we  display  on  500  pixel  by  500  line  monitors.  But  in  the  real  world  the  goal  is  to  process 
5,000  co  10,000  pixels  in  each  dimension.  Will  we  be  able  to  extend  our  lab  systems  to  this  kind  of  reso¬ 
lution,  or  will  we  be  forever  limited  to  rather  small  images? 

A.  A  lot  of  these  approaches  are  presently  somewhat  limited  aa  to  space-bandwidth  product,  possibly  in  the 

1,000  to  10,000  range.  But  there  are  approaches  that  aren't,  such  as  the  one  that  Sawchuk  and  Strand  have 

been  looking  at. 

C.  I  think  that  any  of  che  multiplexing  techniques  are  going  to  be  fundamentally  limited  to  small  images, 
as  you  get  a  phenomenal  matrix  sort  of  representation  with  these  schemes.  I  guess  the  ideal  case  would  be  if 
you  could  process  continuous  data,  then  the  space-variant  processor  would  have  a  space-bandwidth  product 
equivalent  co  a  regular  space-invariant  processor. 

C.  It's  been  mentioned  that  a  digital  processor  is  much  better  than  a  1-D  optical  processor  in  that  the 
digital  equivalent  is  just  a  matrix-vector  multiplication,  which  is  a  quick,  easy  thing  to  do.  But  it's  not 
that  easy  to  do,  say,  a  thousand  component  vector  times  a  1000  x  1000  matrix  -  it  takes  several  milliseconds, 
it  cakes  a  rather  big  box,  and  it's  power  consuming.  The  optical  system  has  a  potential  of  much  faster 
times,  say,  several  microseconds. 

C.  Rlghc  now  there's  about  four  orders  of  magnitude  difference  between  the  speed  of  what  I  believe  to  be  a 
buildable  incoherent  matrix-vector  multiplier  with  reasonably  small  matrices,  say  100  x  100,  as  compared  to 
a  floating  point  system  array  processor.  There  are  military  systems  that  are  faster  than  a  commercial  float¬ 
ing  point  processor,  but  not  four  orders  of  magnitude  faster.  And  power  consumption  Is  something  that  Is 
extremely  important  and  it  is  something  we've  never  addressed  in  this  community  when  making  comparisons  with 
competing  technologies. 

C.  Maybe  we  should  address  the  question  of  why  these  things  haven’t  been  packaged  in  the  past.  At  a  con¬ 
ference  in  1972  on  future  directions  in  optical  processing,  people  said  things  about  packaging  and  how  are 
we  going  co  make  these  things  viable,  and  they  said  a  lot  about  spatial  light  modulators.  Well,  I  see  in 
the  1-D  processing  case  you  have  a  wide  range  of  fairly  available  devices. 

R.  Who  said  they  were  going  to  spend  money  on  packaging?  Nobody  did.  Everybody  said  that  what  we  really 

need  is  input-output,  but  nobody  was  packaging.  So  somehow  you  have  to  get  the  private  sector  or  the  mili¬ 

tary  so  Involved  that  they  want  to  make  these  things  usable. 

C.  There  is  a  problem  in  digital  processing  that  apparently  has  not  been  solved.  For  image  restoration, 

image  enhancement,  and  the  like  in  which  there  is  a  man  in  the  loop,  how  do  you  know  the  image  is  restored 
or  chat  you  have  some  representation  of  the  image  back?  How  does  thi3  impact  optical  processing? 

C.  What  I  think  you  are  getting  at  is  that  with  a  digital  system  you  can  re-program  it  very  easily.  If 
you  have  a  wide  range  of  software  available,  you  can  interact  with  the  system  in  real  time.  But  with  optics 
It  has  been  difficult  to  adjust  the  system  and  have  a  human  interaction  in  the  loop.  With  various  real  time 
devices  chat  are  coming  out,  chat  might  be  easier,  but  it’s  a  difficult  problem  for  optics  and  for  digital 
systems,  coo. 

C.  Getting  back  to  Harper's  question,  there's  a  great  need  to  process  images  with  a  large  number  of  points. 
5,000  x  5,000  is  not  at  all  unrealistic,  especially  for  earth  resources  pictures,  radio-raohic  Images,  and 
the  like.  We  were  calking  before  about  examples  of  where  you  would  like  to  do  space-vcriant  restorations. 

In  almost  any  kind  of  radiographic  Image  you  have  space-variant  degradation  of  some  sort,  and  if  you're  in¬ 
terested  in  details  there  you'd  like  to  do  restoration.  Also,  we  ought  to  chink  a  little  more  about  discrete 
time  and  discrete  space  systems  because  digital  systems  operate  this  way.  If  we're  going  to  build  some  op¬ 
tics,  we'd  better  make  it  incerfaceable  with  a  digital  system.  I  think  things  like  the  matrix-vector  de¬ 
scription  of  a  space-variant  processor  are  Important  and  should  be  looked  at  a  good  deal  in  the  future. 

C.  We  have  co  realize  that  packaging  any  coherent  system  is  very  environmentally  difficult,  especially  one 
chat  has  any  kind  of  interferometric  detection.  I  think  people  in  research  view  thst  as  more  of  a  develop¬ 
ment  cask,  they  like  co  come  with  the  ideas  but  they  wish  someone  else  would  worry  about  putting  it  in  a 
little  box.  An  impressive  packaging  success  story  is  the  laser  gyroscope  which  is  going  into  the  Boeing  767. 

C.  There  is  another  application  area  besides  image  processing,  and  that  is  the  evaluation  of  lncegral 
transforms  that  are  space-variant. 

C.  If  we're  setting  the  tone  for  the  whole  discussion  of  where  to  go  optically,  I  believe  we  have  to  con¬ 
sider  digital  systems  in  the  sense  that  they  provide  the  control  and  decision  making  functions.  When  we  go 
out  of  basic  research  and  start  talking  about  applications,  we're  trying  to  take  the  man  out  of  the  loop 


somewhere.  Bob  calks  abouc  real  time,  you  have  Co  cake  Che  man  ouC  of  Che  loop  in  dlgical  syacems.  VI ch 
chac  in  olnd,  we  can  chink  of  opcics  as  providing  parcial  solucions  for  problems  in  che  sense  chac  ic  is  a 
preprocessing  funcCion,  and  Chen  lec  che  dlgical  syscem  work.  Thae  makes  some  of  che  basic  research  look 
aecraccive. 
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Abstract 


Achieving  flexibility  in  optical  pattern  recognition  systems  by  novel  hybrid  optical/digital  techniques  is 
considered.  Increased  use  of  digital  pre-  and  post-processing  together  with  synthetic  filt  rs  or  discrimin¬ 
ants  and  pattern  recognition  techniques  beyond  matched  filtering  are  discussed. 

1.  Introduction 


Pattern  recognition  (PR)  [1-3]  is  one  of  the  most  complex  and  all  encompassing  data  processing  problems 
that  we  face  in  the  1980s.  Sensor  technology  [4-5]  has  recently  ac.  eved  the  capability  to  produce  data  of 
sufficient  quality  and  at  such  high  resolution  and  data  rate'  :hat  exceed  our  ability  to  process  and  analyze 
it  in  a  timely  manner  [6-7].  Optical  processing  has  long  been  attrsctive  for  its  real-time  and  parallel  pro¬ 
cessing  features.  However,  the  flexibility  and  repertoire  of  operations  achievable  in  optical  processors  re¬ 
mains  quite  limited  and  hence  their  use  in  practical  PR  eys-.ems  han  not  yet  materialized . 

The  optics  community  has  recognized  this  shortcoming  anc  has  recently  responded  with  a  variety  of  new 
algorithms  and  architectures.  Many  of  these  concepts  use  •:  .s  .  that  are  well-known  In  the  mathematical  and 
digital  pattern  recognition  literature.  In  this  pap *r .  -**  .  review  these  advanced  PR  approaches  with 

attention  to  how  they  increase  the  processing  flexibility  of  optical  systems.  The  central  unifying  theme 
chosen  is  hybrid  optical/digit? 1  processing,  whereby  the  advantages  of  optical  and  digital  technology  can  best 
be  combined.  Although  PR  is  the  specific  application  are*  discussed,  the  concepts  and  philosophies  advanced 
are  of  use  in  other  areas  as  well. 

The  accuracy  of  an  optical  processor  i3  a  second  major  area  of  concern.  It  is  not  directly  addressed  in 
this  paper,  but  is  of  concern.  Thus  we  note  that  optical  numerical  processors  [8-9]  using  residue  arithmetic 
and  operating  on  digital  data  are  also  the  subject  of  current  research.  Of  more  direct  concern  (to  the  image 
PR  topic  of  this  paper  and  the  above  issue  of  accuracy)  is  the  concept  of  data  SNR  and  system  dynamic  range. 

It  has  recently  been  shown  that  in  most  real-world  cases  detection  performance  is  data-limited  rather  than 
processor-limited  [10],  Thus  the  superior  precision  obtainable  in  a  digital  system  is  of  less  concern.  Ba¬ 
sically,  the  point  reduces  to  whether  the  dynamic  range  of  the  optical  system  exceeds  the  SNR  of  Che  input 
daca.  If  this  is  the  case  (as  it  appears  to  be),  the  optical  system  introduces  no  errors  in  the  processing 
and  its  accuracy  is  thus  adequate.  Thus,  the  major  concern  of  this  paper  is  Che  flexibility  of  the  optical 
syscem  and  therein  che  hybrid  optical/digital  processor  concept  and  algorithm  flexibility  Issues. 

2.  Problem  definition  and  solution  conceptualization 

The  PR  problem  can  be  described  as  determining  the  presence  and  location  of  a  stored  key  object  (reference 
image)  in  an  on-line  sensed  image.  The  key  issue  in  all  practical  PR  problems  is  to  maintain  recognition  when 
the  input  and  reference  differ  for  various  expected  and  practical  reasons.  The  two  major  classes  of  image 
differences  of  concern  can  be  described  as  geometrical  and  textural.  Geometrical  differences  between  the  in- 
puc  and  reference  images  arise  due  to  scale,  rocation,  aspect  and  other  such  errors.  Textural  differences  are 
due  to  seasonal  or  other  temporal  differences  and  to  multi-sensor  effects  (e.g.  the  reference  and  input  imag¬ 
ery  are  taken  ac  different  times  and/or  from  different  sensors). 

The  concept  of  an  observation  space  on  which  to  operate  is  che  first  issue  of  concern.  Fourier  transform 
(FT)  and  image  planes  are  che  most  obvious  and  most  easily  realized  choices  (Sect.  3).  Statistical  PR  Issues 
are  given  far  more  attention  in  digital  and  mathematical  formulations  than  in  optical  systems.  This  trend 
should  be  altered.  Use  of  digital  processors  for  simulation  and  control  of  optical  systems  and  electronic 
techniques  for  daca  normalization,  detection  and  estimation  also  deserve  note  (Sect.  4)  as  do  alternate  PR 
methods  beyond  classical  matched  spatial  filters  (MSFs)  (see  Sects.  6-7). 

In  Fig.  1,  che  general  block  diagram  of  a  flexible  and  practical  hybrid  optical/digital  PR  system  is  shown. 
A  discussion  of  this  schematic  is  of  use  in  providing  an  overall  introduction  to  the  subjects  of  processing 
flexibility,  practical  PR  problems,  and  hybrid  optical/digital  PR  systems.  From  this  figure,  we  notice  two 
major  elements:  che  digital  pre-  and  post-processor.  We  also  note  the  use  of  synthetic  references  or  dis¬ 
criminant  functions  rather  chan  conventional  MSFs.  In  most  practical  PR  cases,  the  input  data  must  be  pre- 
processed  before  being  input  to  the  optical  processor.  Specific  examples  of  this  on-line  pre-processing  are 
noted  in  Sect.  5.  In  many  cases,  appropriate  synthetic  reference  functions  (or  more  appropriately:  filters 
or  discriminant  features)  can  be  generated  off-line  by  digital  techniques.  We  distinguish  becween  determin¬ 
istic  (Sect.  6)  and  statistical  ISect.  7)  versions  of  these  synthetic  discriminants.  We  also  note  chac  a  dis¬ 
cussion  of  such  Issues  is  quite  applications  oriented  and  thus  our  discussions  of  such  systems  will  refer  to 


specific  PR  problems  to  provide  the  necessary  in-depth  detail  required  to  select:  observation  spaces,  pre¬ 
processing  techniques,  and  synthetic  discriminant  functions.  In  Sects.  4  and  8,  we  briefly  address  the  issues 
of  digital  post-processing.  However,  the  major  theme  in  Sects.  8  and  9  is  the  use  of  advanced  PR  techniques 
beyond  the  MSP  and  the  fact  that  such  systems  can  be  realised  more  efficiently  by  hybrid  optical/digital  archi¬ 
tectures. 

3.  Image  and  FT  plane  sampling 

The  hybrid  optical/digital  PR  concept  shown  in  Fig.  2  is  adapted  from  descriptions  of  a  system  under  devel¬ 
opment  at  the  Engineer  Topographic  Laboratory  (ETL)  Ill].  This  system  i6  simple  in  concept  and  yet  serves  to 
introduce  many  key  hybrid  optical/digital  PR  concepts.  The  input  image  is  scanned  and  the  FT  and  image  of  625 
sampled  scene  regions  are  formed  sequentially  at  both  P^y  and  Pyy.  A  wedge/ring  detector  [12]  placed  at  Pyy 
provides  directional  and  spatial  frequency  information  on  each  sampled  scene  region.  The  output  from  a  32  x  32 
element  solid-state  detector  at  is  used  to  obtain  statistical  data  such  as  the  mean  and  variance  for  each 
image  region. 

These  wedge,  ring  and  statistical  data,  plus  context  Information,  are  analyzed  in  a  digital  post -processor 
to  determine  input  image  content.  Initial  tests  of  this  concept  have  proven  useful  in  locating  structured 
road  regions  of  a  scene  [11]  and  in  the  analysis  of  the  textural  information  content  of  radar  and  visible  imag¬ 
ery  [12].  Our  major  concern  with  this  concept  is  its  use  of  digital  post-processing  on  multi-domain  optically 
generated  data  and  its  use  of  statistical,  textural,  and  context  image  data.  These  latter  aspects  of  imagery- 
have  rarely  been  used  in  prior  optical  processors.  Initial  tests  have  Indicated  that  significant  image  infor¬ 
mation  is  contained  in  aich  data  [11,  12]. 

4 .  Dlgltal/electronlc  adjuncts 

Digital  techniques  have  extensive  use  in  che  simulation  [13]  and  control  [14]  of  optical  processors,  plus  in 
the  production  of  computer  generated  holograms  [15].  The  conversion  of  sensor  data  to  optical  transparencies  re¬ 
quires  electronic  interfacing.  These  uses  of  digital  and  electronic  techniques  are  of  less  concern  in  this  paper 
and  we  will  thus  concentrate  on  cases  in  which  the  digital  and/or  electronic  system  performs  a  more  major  processi 
role.  Recent  advances  in  smart  sensors  [4-5]  ana  solid  state  detectors  have  made  digital/electronic  pre-/post- 
processlng  feasible.  Advanced  optical  PR  systems  should  capitalize  on  such  advances  in  related  disciplines. 

A  recent  in-depth  caae  study  of  optical  word  recognition  on  a  microfilm  data  base  [16]  has  resulted  in  the 
hybrid  optical/digital  eyatem  architecture  shown  in  Pig,  3.  This  system  has  three  features  of  concern  in  this 
present  paper.  First  the  dc  value  of  the  FT  of  the  input  page  is  a  useful  measure  of  the  data  content  of  the 
input  text  and  can  be  used  to  control  an  input  attenuator  (A)  to  provide  data  normalization,  thus  simplifying 
the  output  detector  decision  system.  Second,  this  particular  application  contained  three  classes  of  data, 
which  were  found  to  be  possible  to  separate  into  classes  by  simple  FT  plane  analysis.  Third,  three  detection 
criteria  (threshold,  area  and  volume  detection)  were  analyzed  and  the  more  advanced  methods  were  found  to  be  of 
considerable  use  and  to  be  easily  realized  by  simple  detector  modifications.  Such  techniques  require  more  ex¬ 
tensive  data  bases  to  determine  their  usefulness. 

5.  Real-time  digital  pre-processing 

In  this  section,  we  consider  several  pre-processing  operations  that  need  be  performed  on  che  input  and  ref¬ 
erence  data  to  facilitate  correlation  and  to  increase  the  system's  flexibility.  These  operations  are  best  seen 
by  considering  specific  PR  case  studies. 

A  major  source  of  error  In  PR  systems  is  the  presence  of  geometrical  differences  between  the  input  and  ref¬ 
erence  scenes.  By  correlating  coordinate  transformed  versions  of  the  data,  a  PR  system  Invariant  to  different 
geometrical  distortions  between  the  input  and  references  images  can  be  produced.  The  coordinate  transformation 
chosen  determines  the  geometrical  error  to  which  the  processor  is  invariant.  The  general  system  block  diagram 
of  Fig.  4  is  quite  simple.  It  is  a  conventional  frequency  plane  correlator  [17]  with  a  coordinate  transforma¬ 
tion  pre-processing  box.  The  combination  of  a  coordinate  transformation  pre-processor  and  a  space-invariant 
optical  correlator  results  in  a  space-variant  system,  whose  flexibility  and  practicality  exceed  that  of  the 
normal  system. 


The  CT  operation  can  be  achieved  in  a  digital  pre-processor  and  since  the  operation  must  be  performed  in 
real-time  on  the  input  data,  this  class  of  system  Is  treated  In  this  present  section.  The  details  of  this  type 
of  processor  and  demonstrations  of  Its  use  in  many  cases  have  been  described  elsewhere  [18].  One  example  of  a 
rotation-invariant  space-variant  system  it  shown  In  Fig.  5.  The  Inputs  (top)  are  diatom  cells  in  different 
orientations.  The  optically  produced  correlations  are  shown  m  the  bottom  and  their  crots-sectlonal  scans  in 
the  center  of  Fig.  5.  As  seen,  the  system  is  invariant  to  rotational  differences  between  the  input  and  refer¬ 
ence  and  the  rotational  differences  can  be  found  from  the  location  of  the  correlation  peak. 

As  a  second  case-study  for  which  on-line  image  pre-processing  is  needed,  we  consider  che  correlation  of  a 
sensed  input  image  and  a  synthetic  reference  image.  This  scenario  arises  in  an  advanced  cruise  missile  termi¬ 
nal  guidance  problem.  Figures  6s  and  6b  show  typical  examples  of  the  sensed  snd  synthetic  data.  The  low  out¬ 
put  optical  correlation  obtained  is  shown  in  Fig.  6c.  This  system  performance  is  due  to:  the  considerable 
image  texture  present  in  the  sensed  scene  and  not  in  the  synthetic  one;  the  added  small-surface  detail  (c.g. 
the  roof  of  the  building)  present  in  the  tensed  Image;  the  presence  of  objects  (e.g.  cars  and  trees)  in  one 
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scene  and  not  in  Che  ocher;  concrasc  reversals  and  gray  level  differences  in  che  scenes,  ecc. 

These  differences  conscience  noise  racher  chan  information,  since  chey  are  noc  common  co  boch  scenes.  With 
che  help  of  Technology  Services  Corporacion,  we  have  considered  applicacion  of  various  pre-processing  operacors 
co  such  scenes.  Those  dlgieal  pre-processing  operaclons  considered  include:  hiscogram  equalizaeion,  gray 
level  modif icacion,  edge  enhancement  and  small  surface  lysing.  The  firsC  cvo  operacors  make  large  image  areas 
more  uniform  in  inCensiCy.  The  chird  operacor  enhances  edges  and  scruccural  scene  daca,  whereas  Che  fourch 
operaced  removes  small  surfaces  and  objeccs  presenc  in  only  one  of  che  imagery. 

The  resulcs  of  such  operacors  are  shown  in  Figs.  7a  and  7b.  They  resulc  in  a  considerably  enhanced  correla- 
cion  peak  SNR  as  seen  in  Fig.  7c.  These  pre-processing  operacors  muse  again  be  realized  in  real-cime  and  hence 
are  included  in  our  presenc  discussion.  Advances  in  smare  sensor  cechnology  as  well  as  diglcal  and  CCD  hard¬ 
ware  make  such  operations  possible  in  conventional  cechnology.  We  feel  chat  optical  processors  should  make  use 
of  such  advances  in  ocher  cechnologies  by  altering  syscem  architectures  and  algorithms  as  shown,  racher  chan 
by  striving  to  achieve  such  operations  within  the  optical  system  itself. 

6 .  Svntheclc  discriminant  functions  (deterministic) 

In  the  third  class  of  hybrid  optical/digital  processors  that  we  consider,  che  digital  computer  is  used  to 
synthesize  the  reference  function(s) .  These  reference  functions  are  synthetic,  being  produced  from  linear 
combinations  of  mathematical  functions.  The  weighting  coefficients  and  basis  functions  used  aTe  determined 
after  extensive  covariance  matrix  analysis  and  testing.  Because  of  this,  che  operations  required  to  synthe¬ 
size  che  optimum  reference  filter  muse  clearly  be  performed  by  a  digital  processor.  Moreso,  since  the  same 
reference  filter(s)  can  be  used  to  recognize  any  input  of  a  given  class,  the  filter  synthesis  can  be  off-line. 
Hence,  che  title  chosen  for  this  class  of  hybrid  opclcal/dlgltal  processors  adequately  reflects  che  new  role 
played  by  the  digital  syscem. 

Related  efforts  in  this  area  have  recently  been  reported.  It  was  first  proposed  [19]  to  use  N  reference 
functions  to  recognize  N  patterns.  When  one  pattern  was  present  at  che  input,  9  correlation  outputs  resulted. 

A  weighted  linear  3um  of  these  N  outputs  could  then  be  used  to  determine  the  input  pattern  present. 

In  more  recent  work,  use  of  a  nonredundant  set  of  synthetic  references  was  considered  [20].  To  recognize  N 
patterns,  only  K  »  log2  N  references  are  used.  The  K  output  correlations  are  thresholded  and  constitute  a 
K-bic  output  binary  word  that  can  (after  decoding)  denote  che  input  present.  Use  of  the  linear  discriminant 
function  theory  that  is  widely  used  in  digical  PR  has  recently  been  suggested  to  produce  generalized  matched 
spatial  filters  [21]  cor  use  in  PR.  Synthetic  references  that  comprise  the  key  features  of  biological  algae 
have  also  been  successfully  used  [22]. 

Yet  another  different  but  related  approach  [23]  that  provided  more  detailed  description  has  been  reported. 
This  technique  used  linear  basis  function  expansion  and  covariance  matrix  computation  and  diagonalization  to 
determine  a  single  multi-variant  filter  chat  could  recognize  all  representations  of  an  input  object,  with  both 
intensity  and  geometrical  differences  presenc.  In  this  approach,  each  input  image  g  in  the  data  set  {gn}  of 
imagery  to  be  recognized  is  first  written  as  a  linear  sum  of  basis  functions  * j  ,  gn  »  Ianj®j  .  The  single  de¬ 
sired  reference  or  discriminant  fugetion  h  is  likewise  expressed  as  h  »  Zbj®j.  To  determine  and  bj ,  the 
cross-correlation  macrix  R^j  *  gi©gj  is  computed.  Diagonalization  of  R^.  yields  the  a„j  and"®,  .  We  then 
require  the  correlation  Rn  •  gn^h  of  any  gn  with  h  to  yield  the  same  constant  value  c.  If  che  Oj  are  ortho¬ 
normal,  Rn  *  lanjbj  ■  c  and  we  can  thus  find  bj  and  hence  h. 

The  data  base  chosen  to  demonstrate  this  concept  consisted  of  infrared  tank  imagery  of  the  same  object  in 
different  aspect  views.  A  portion  of  the  training  set  {g,,}  used  is  shown  in  Fig.  8.  Optical  weighted  MSF 
synthesis  [24]  was  used  to  determine  the  optimum  filter  passband  of  spatial  frequencies  co  use.  This  accounts 
for  the  intensity  differences  present  in  IR  and  multi-sensor  imagery  as  discussed  elsewhere  [25].  The  cross- 
correlation  matrix  R^,  wa3  formed  (Fig.  9)  and  diagonalized  (Fig.  10),  thereby  determining  the  anj  and  ij 
values  and  tunc  cions.  Requiring  R,^  ■  c  provided  us  with  che  bnj  values.  The  synthetic  discriminant  function 
h  so  produced  is  shown  in  Fig.  11.  A  transparency  of  ic  was  formed.  An  optical  matched  spatial  filter  of  it 
was  then  produced  and  placed  in  the  Fourier  plane  of  a  frequency  plane  correlator.  The  cross-sectional  scans 
through  one  of  che  resultant  Rti  correlations  are  shown  in  Fig.  12.  All  output  correlations  Rn  of  seven  widely 
different  aspects  gn  of  the  tank  yielded  quite  identical  peak  R^  values  as  predicted. 

This  philosophy  in  which  digital  processing  techniques  are  used  to  compute  synthetic  discriminants  (by 
deterministic  methods)  off-line  represents  a  major  new  hybrid  opticla/digital  pattern  recognition  approach 
chat  merits  far  more  attention. 

7 .  Alternate  feature  spaces  and  hybrid  PR  techniques 

Within  che  PR  and  digital  image  processing  literature,  many  alternate  PR  techniques  exists  beyond  the 
simple  matched  spatial  filter.  Hybrid  optical  PR  algorithms  and  architectures  should  make  use  of  such  avail¬ 
able  research. 

As  one  example  of  such  a  hybrid  PR  system,  we  consider  the  use  of  invariant  moments  for  PR.  It  has  been 
shown  that  linear  combinations  of  the  ordinary  moments  (up  to  third-order)  of  a  scene  can  be  combined  to 
realize  seven  invariant-moments  [26].  Digital  experiments  have  shown  [26-28]  that  these  moments  are  invariant 
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to  all  geometrical  and  intensity  differences  in  ar.  image. 

Computation  of  the  ordinary  moments  m^  of  a  high-resolution  2-D  scene  is  quite  complex,  however,  an 
optical  system  such  as  the  one  in  Fig.  13  can  easily  compute  the  mpq  for  a  given  f(x,y)  input  when  appropriate 
masks  are  used  at  P2.  When  g  *  1,  x,  y,  xy,  x-  the  P,  output  uj  equals  mgo,  n10>  ra01>  lr‘ll>  m2n>  respectivelv , 
etc.  A  dedicated  digital  post-processor  can  then  compute  the  invariant  moments  from  these  mpq  values. 

This  particular  hybrid  PR  concept  [29]  and  other  such  ones  merit  research  analysis.  The  system  architec¬ 
ture  in  Fig.  13  demonstrates  many  specific  features  of  hybrid  processing.  Since  the  dynamic  range  of  the  m-c 
are  30  dB  whereas  the  ?n  are  quite  large  (200  dB)  and  since  the  operations  required  to  obtain  the  tn  from,  the 
mp  involve  addition,  subtraction,  multiplication  and  division,  the  hybrid  architecture  shown  appears  to  be 
well  chosen. 

Such  a  proper  assignment  of  operations  to  the  optical  and  digital  processing  portions  of  a  system,  is  essen¬ 
tial.  Likewise,  this  selection  should  be  made  with  speed  and  component  requirements  in  mind.  In  instances 
such  as  the  one  shown,  digital  processors  can  play  a  considerable  role  as  post-processors. 

8 .  Summary  and  conclusions 


In  prior  sections,  we  have  considered  five  classes  of  hybrid  optical  digital  systems.  In  each  case  the  role 
of  the  digital  processor  differs;  but,  in  all  cases,  the  combination  of  an  optical  and  digital  processor  is 
chosen  to  increase  flexibility. 

In  the  cases  considered  in  Sect.  4,  digital  and  electronic  systems  were  used  as  adjuncts  to  optical  systems. 
Cases  included  were:  digital  simulation,  digital  control  and  data  normalization  plus  alternate  detection 
methods  using  advances  in  solid-state  detectors  and  electronics. 

In  the  second  class  of  hybrid  system  (Sect.  3),  the  digital  system  was  used  as  a  post-processor  operating 
on  area  sampled  image  and  frequency  plane  data.  This  system  is  of  particular  interest  as  it  is  one  of  the  few 
optical  processors  to  employ  statistical  data  analysis. 

The  third  class  of  hybrid  system  (Sect.  5)  employed  digital  pre-processing.  The  specific  digital  pre¬ 
processing  techniques  included  must  be  realized  in  real-time  on  the  input  imagery.  They  include:  histogram 
equalization,  gray  level  modification,  edge  enhancement,  and  small  surface  lysing,  plus  coordinate  transfor¬ 
mations. 

The  fourth  class  of  hybrid  system  (Sect.  6)  also  used  pre-processing  by  the  digital  system.  However,  in 
this  case,  extensive  off-line  processing  was  used  to  produce  synthetic  discriminant  functions  for  pattern 
recognition. 

Such  departures  from  classic  matched  spatial  filtering  are  essential.  An  example  of  such  alternate  pattern 
recognition  methods  (our  fifth  class  of  hybrid  system)  was  presented  in  Sect.  7. 

The  invariant  moment  technique  advanced  in  Sect.  7  is  typical  of  the  novel  hybrid  PR  systems  that  deserve 
further  attention.  The  optical  conmmnity  must  become  more  aware  of  digital  PR  techniques,  smart  sensors,  and 
dlgltal/electronic  hardware  advances.  Such  items  must  be  incorporated  into  future  hybrid  systems  if  optical 
processors  are  to  become  practical.  More  attention  to  statistical  techniques  such  as  in  [11]  and  [30]  should 
be  included  in  optical  processors.  Optical  researchers  should  also  take  care  to  insure  that  they  address  real 
and  practical  problems  for  which  digital  methods  are  not  adequate. 
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11.  Figures 


Figure  1  General  block  diagram  of  a  hybrid 
optical/digital  processor. 


Figure  3  Hybrid  processor  for  optical  word  recogni¬ 
tion  [16]. 
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Figure  2 


Schematic  Jiagram  of  a  hybrid  processor 
using  image  and  frequency  plane  sampling 
( adapted  from  ' 11 ] ) . 


Figure  4 


Space-variant  hybrid  processor. 
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Figure  8 


Representative  imagery  for  synthetic 
discriminant  feature  processor  [23]. 


Figure  11 


Synthetic  discriminant  function  gener¬ 
ated  [23]  . 
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Figure  9  Correlation  matrix  for  seven  images  in 
Figure  8  set  [ 23 ] . 


Figure  12  Cross  sectional  scans  through  the  corre 
lation  peak  output  from  the  correlation 
of  Figures  8  and  11  [23] . 
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Figure  10  Diagonalized  correlation  matrix  (23). 
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Figure  13  Hybrid  invariant  moment  processor  [291. 


Discussion  (B.  V.  K.  Vijaya  Kumar;  Discussion  Leader:  Nicholas  George) 

C.  1  want  to  point  out  that  there  is  a  growing  interest  and  need  for  optical  systems  which  do  verv  limited 

f  tasks,  i.e.  spectral  analysis  or  correlations,  that  can  contribute  to  a  larger  system.  In  that  case,  packag¬ 

ing  becomes  an  important  consideration.  One  must  build  a  system  that  is  compatible  with  the  larger  system  it 
is  going  to  fit  into,  in  terms  of  size,  weight,  power  consumption,  and  input/output.  A  different  way  of  look¬ 
ing  at  hybrid  optical  systems  is  that  one  builds  a  small  package  which  fits  into  an  overall  processor - 

Q.  1  feel  that  the  weak  link  here  might  be  things  like  A/D  conversion.  Will  that  slow  down  your  ultimate 

process? 

'  A.  In  the  case  of  invariant  moments,  we  are  looking  at  only  a  small  number  of  values  at  the  interface,  since 

computation  is  done  in  the  processor. 

C.  I've  heard  references  from  several  speakers  to  the  engineering  problems  associated  with  putting  optical 
components  into  systems.  I  think  we  need  to  be  careful  in  the  university  research  atmosphere  of  not  putting 
too  much  emphasis  on  that  as  a  major  limitation.  I  think  the  engineering  aspects  are  better  addressed  in  the 
context  of  industrial  research  than  in  the  context  of  university  research. 

Q.  What  type  of  question  do  you  think  the  university  researchers  should  be  asking  themselves? 

A.  The  questions  of  function  to  be  implemented,  form  and  function,  not  fit. 

R.  We  shouldn't  be  doing  development  in  the  university,  but  there  may  be  concepts  that  might  be  found  to 
allow  us  to  package  optical  systems  more  efficiently  and  thus  make  optical  processors  more  practical. 

Q.  Where  does  pattern  recognition  stand  right  now?  Can  we  pretty  well  pattern  recognize  anything  we  want, 
or  is  it  a  wide  open  field? 

A.  In  the  medical  community  they  have  a  fair  degree  of  success,  but  trying  to  extract  information  out  of 
natural  scenes  from  real  time  sensors  or  photographic  sensors  is  very  difficult. 

Q.  Where  could  people  who  are  working  outside  the  military  consnunlty  get  a  set  of  pictures  which  they  could 
use  as  a  standard  for  working  and  sorting? 

A.  The  problem  of  images  to  work  on  is  very  difficult.  1  [Harper  Whitehouse]  was  associated  with  the  TTCP, 
Tripartite  Technical  Cooperation  Program,  with  the  U.S.,  England,  Canada,  Australia,  and  New  Zealand  just 
with  regard  to  l.R.  images.  It  was  agreed  approximately  a  year  ago  that  a  data  base  would  be  established  and 
wculd  be  made  available  on  computer  compatible  tape.  That  study  to  determine  the  feasibility  of  generating  a 
data  base  was  assigned  to  J  Advisory  Group,  number  11,  which  was  formed  about  a  year  ago.  I  believe  anybody 
who  wishes  to  get  information  on  scenes  in  the  l.R.  would  be  well  advised  to  contact  J  Advisory  Group  through 
the  Washington  representatives. 

C.  A  few  years  ago, we  got  Interested  in  the  issue  of  clutter-  and  contrast  in  imagery.  We  found  that  the 
Air  Force  was  interested  in  having  pilots  rank  scenes  as  to  the  expected  degree  of  difficulty  in  acquiring 
certain  targets,  and  they  were  interested  in  the  issue  of  what's  a  cluttered  scene.  They  had  pilots  rank 
different  aerial  scenes  according  to  clutter,  and  we  were  looking  for  some  objective,  mathematical  measures 
for  clutter.  -It  makes  me  think  that  in  some  groups  there  have  been  varying  degrees  of  gradings  of  aerial 
imagery,  but  I  imagine  it  is  a  very  task-dependent  type  of  thing. 

C.  A  point  about  compatibility:  even  in  the  digital  cast  it  hasn't  been  fully  accomplished  yet,  there  are 
very  few  instruments  you  can  get  and  just  plug  together. 

Q.  Talking  about  hybrid  schemes  and  optical  processing  in  general,  what  does  the  group  see  as  the  total 
mission  or  goal?  It  seems  that  optical  data  processing  is  trying  to  compete  with  the  Cray -l  computer,  and 
that  aiay  not  be  a  good  place  to  work.  We  would  rather  .identify  specific  applicstions  like  a  pattern  recog¬ 
nition  system  that  handles  a  specific  task,  or  a  spectrum  analyzer.  You  look  at  what  you  have  to  do,  and 
you  know  that  optics  does  some  things,  like  Fourier  transforms,  very  well.  Do  people  see  a  mix  of  applica¬ 
tions? 

A.  There  was  reference  to  this  question  in  1972  st  the  meeting  at  Camegie-Mellon  and  it  was  interesting 
that  there  was  really  no  one  point  where  anyone  gave  the  answer.  I  think  we  should  recognize  that  what  you 
are  doing  in  your  own  labs  that  you  are  the  most  interested  in  could  well  be  the  direction  that  is  moving 
ahead.  These  directions  have  to  come  out  kind  of  subtly. 

R.  You  can  specify  in  the  negative  that  you  shouldn't  be  working  in  problems  that  can  be  done  digitally. 

C.  I  was  Intrigued  by  the  use  of  Invariants.  Tom  Newman  at  Texas  Tech  is  doing  very  interesting  work  in 

digital  pattern  recognition  based  on  a  group  theoretic  approach,  and  the  invariants  you  are  calculating  are 
different.  It  is  an  interesting  approach  because  statistical  pattern  recognition  has  not  provided  all  the 
answers  that  people  though  it  would,  and  we  need  some  novel  approaches. 
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Comments  by  Tom  '.’.evman:  'ty  feeling  about  Invariance  is  that  there  are  so  many  effects  that  are  actually  de¬ 
terministic  in  nature  rather  than  stochastic  that,  if  we  are  not  careful,  we  can  get  into  the  statistical 
realm  a  bit  too  soon.  The  mathematical  theory  of  invariance  is  quite  old  and  to  a  certain  extent  a  well 
developed  area,  an  area  which  I  feel  is  highly  appropriate  to  be  looked  at.  In  John  Walkup’s  talk,  the  def¬ 
inition  he  gave  for  space-variance  and  space- invariance  would  be  given  in  a  group  theoretical  context  as 
"Spatially  variant  systems  have  a  group  of  invariance  which  is  the  translation  group."  In  many  other  systems 
it  is  equally  possible  to  Identify  a  particular  class  of  transformations  which  lead  to  the  images  or  objects 
under  some  Invariance.  Consider  Che  Fourier  transform,  you  get  something  chare  which  is  not  classical  invar¬ 
iance  buc  is  related  to  it  in  chat  the  translation  becomes  a  phase  change,  and  chis  is  also  dealt  with  in 
invariance  cheory.  In  my  own  work  I  am  not  really  in  optical  processing  per  se,  buc  I  look  at  motion  as  it 
appears  in  images  and  how  we  can  handle  problems  associated  with  motion.  Not  only  can  you  handle  the  motion, 
and  many  ocher  things  permitting  Che  same  general  model,  but  also  certain  things  like  rotation  and  change  of 
perspective.  Most  recently  I've  been  concerned  with  what  happens  when  you  cake  3-D  images  and  project  them 
onto  a  2-D  image  plane.  By  examining  data  in  the  image  plane,  we  seek  to  determine  what  is  happening  in  the 
3-D  world.  I  chink  chis  is  a  very  important  problem.  We  have  to  realize  that  in  Che  front  and  of  a  2-D 
opclcal  processor  there  was  an  ulcimate  recognition  problem  which  doesn'c  really  lend  Itself  well  to  optical 
processing. 
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Abstract 

A  review  of  the  state-of-the-art  in  nonlinear  optical  information  processing  is 
presented.  Due  to  space  limitations,  the  empnasis  is  or.  nonlinear  point  functions.  Hie 
three  major  techniques  of  point  nonlinear  processing  are:  halftoning;  inuensity-to-spatia. 
frequency  conversion;  and  direct  nonlinear  processing  using  the  inherent  characteristics 
of  image  detection  and  modulation  systems.  Application  examples  and  real-time 
implementation  of  these  techniques  are  described.  Other  less  well-developed  metnoas  of 
nonlinear  processing  are  covered  oriefly  and  references  to  all  these  techniques  are  given. 
Some  prospects  for  future  research  are  also  presented. 

1 .  Introduction 


There  is  a  great  general  need  for  systems  that  can  perform  fast,  paraiie. 
multi-dimensional  operations  on  signals  with  large  time-bandwiath  anc  space-bandwidtr. 
products.  The  time-bandwidth  or  space-bandwidth  product  of  a  signal  is  a  measure  of  its 
complexity,  and  in  many  cases,  traditional  analog  or  digital  electronic  systems  are 
overburdened  or  simply  inadequate.  The  need  for  great  processing  capability  arises  in 
guidance,  control,  image  processing  [1,2],  radar  signal  processing  [3],  image  pattern 
recognition  [4,5]  and  machine  perception. 

The  parallel  nature  of  optical  systems  and  their  inherently  large  space-uanowiatn 
product  has  led  to  the  development  of  many  systems  and  techniques  for  optical  information 
processing  [6],  A  fundamental  difficulty  with  optical  processing  has  been  tne  iimiteo 
range  of  operational  "software*  available  [7,8].  Thus,  general  nonlinear  operations  sucn 
as  logarithms,  power  laws,  and  limiters  have  been  very  hard  to  implement,  while  linear 
operations  such  as  correlation,  convolution,  and  Fourier  filtering  have  been  relatively 
easy.  Many  new  techniques  of  signal  processing  and  pattern  recognition  require  nonlinear 
functions  as  part  of  their  operation,  and  these  functions  have  been  acnieved  digitally, 
although  in  serial  form  [2],  In  this  paper  we  describe  a  large  number  of  tecnniques  for 
achieving  these  and  many  other  nonlinear  operations  in  optical  systems.  Many  of  tne 
techniques  utilize  real-time  optical  input  transducers  which  can  convert  electronic  or 
image  information  into  a  form  suitable  for  input  to  an  optical  processor  [9].  with  most 
of  these  techniques,  the  processing  is  performed  almost  exclusively  in  an  analog  fashion. 
Recently,  several  concepts  for  binary  [10-21]  or  residue  [22-28]  numerical  optical 
processing  have  been  developed  in  which  the  signals  are  processed  as  discrete  levels 
within  the  system.  This  new  approach  holds  much  promise  for  the  future  if  real-time 
processing  speed,  accuracy,  and  flexibility  can  be  maintained.  We  show  in  this  paper  now 
some  of  these  operations  can  be  treated  as  a  form  of  nonlinearity. 

Since  the  class  of  nonlinear  operations  is  so  broad  and  ill-defined,  we  restrict 
discussion  in  this  paper  to  the  well-defined  subset  of  point  (memoryless)  non! inea r i ties 
where  the  output  at  any  point  is  a  nonlinear  function  of  exactly  one  input  point. 
Although  this  excludes  much  research  in  nonlinear  processing,  it  includes  a  significant 
fraction  of  the  work  done  thus  far  and  lays  a  groundwork  for  much  of  tne  worn  witr. 
nonlinear  systems  which  combine  a  point  nonlinearity  with  other  processing.  A  broaoer 
range  of  nonlinear  systems  are  discussed  in  [29]  from  wnicb  this  paper  has  been 
abstracted.  One  important  class  of  nonlinear  processing  systems  which  are  not  discussed 
here  are  those  using  feedback  to  alter  the  system  transfer  function  in  a  nonlinear  way. 
Many  excellent  review  articles  have  been  written  on  this  subject  anc  the  interested  reaaer 
is  referred  to  them  [30-34].  Several  other  reviews  of  nonlinear  processing  are  also  in 
the  literature  [32-35]. 

The  emphasis  in  the  description  of  systems  and  experimental  results  in  this  paper  is 
on  work  performed  by  the  authors  and  their  colleagues.  The  reason  for  this  biases 
emphasis  is  that  this  is  the  work  we  feel  most  qualified  to  discuss  and  the  only  worn  we 
feel  qualified  to  discuss  in  detail.  Although  by  no  means  exhaustive,  the  references 
cited  in  the  text  along  with  the  brief  discussions  of  the  cited  works  should  give  a  more 
general  view  of  the  breadth  and  depth  of  tne  research  in  the  area  of  nonlinear  optical 
processing . 
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The  next  several  sections  describe  specific  systems  which  directly  perform  point 
nonlinear  operations  on  two-dimensional  input  functions.  There  are  three  major  categories 
of  techniques:  1)  Halftone  processing;  2)  Intens i ty-to-spa t ial  frequency  conversion;  and 
3)  Direct  nonlinear  processing.  The  best  developed  technique  is  halftone  processing,  ana 
this  section  describes  the  principle  and  gives  experimental  results  and  generalizations 
such  as  pseudocolor.  The  next  section  describes  tneta  modulation  and  a  relatively  recent 
nonlinear  processing  method  relying  on  variable-grating  mode  liquid  crystal  devices.  This 
technique  uses  the  intensi ty-to-spa t ial  frequency  conversion  characteristics  of  these 
devices  to  implement  nonlinear  functions.  The  last  section  describes  electro-optical 
systems  which  directly  implement  nonlinear  functions  by  utilizing  inherent  characteristics 
of  devices. 

2 .  Halftone  processing 

The  halftone  method  of  nonlinear  processing  is  a  two  step  procedure.  The  first  step 
converts  the  continuous  level  two-dimensional  input  signal  into  a  pulse-width  modulated 
(ideally)  binary  input.  This  operation  is  exactly  the  halftone  procedure  used  in  the 
graphic  arts  to  represent  an  image  containing  gray  tones  as  a  binary  picture.  The 
halftoning  step  uses  a  mask  transparency  called  a  halftone  screen  along  with  a  high 
contrast  (ideally,  a  sharp  threshold)  photograpnic  material  or  real-time  coherent  optical 
input  transducer. 

With  both  photographic  or  real-time  halftoning,  the  second  step  of  the  process  is 
Fourier  filtering  and  recombination  of  diffraction  components  in  a  coherent  optical 
system.  The  many  variations  of  halftone  screens  and  filtering  procedures  permit  great 
flexibility  in  the  nonlinear  functions  that  can  be  achieved. 

2. 1  Halftone  processing  principles 

The  halftone  process  has  been  used  for  some  time  in  the  graphic  arts  industry  to 
control  density  transfer  characteristics  in  photo  reproduction.  Halftone  screens 
generally  consist  of  a  one-dimensional  or  two-dimensional  periodic  array  of  identical 
continuous  amplitude  transmittance  profiles,  each  varying  continuously  from  opaque  (t«U  or 
D»«)  to  transparent  (_t=»l  or  D«0)  [36-43].  Figure  1  is  a  diagram  of  the  preprocessing 
steps  for  a  one-dimensional  input.  Dp(x)  shown  in  Fig.  1(a)  is  the  one-dimensional 
continuous  input,  plotted  logarithmically  as  a  photographic  density.  A  typical  halftone 
screen  periodic  density  profile  is  Shown  as  Ds(x)  in  Fig.  1(b).  In  the  preprocessing 
step,  the  continuous  input  and  halftone  screen  are  placed  together  and  are 
photographically  copied  (by  imaging  or  contact  printing)  onto  a  high  contrast  recording 
medium  that  ideally  has  a  sharp  threshold  response  as  shown  in  Fig.  1(d).  Figure  ltd) 
shows  the  ideal  transmittance  of  a  high  contrast  reversal  photographic  material  vs.  an 
input  scale  Dj.n.  D^n  is  proportional  to  the  logarithm  of  exposure  through  the  sandwich  of 
input  and  halftone  screen.  The  Dt  shown  in  Figs.  1(c)  and  1(d)  is  a  clip  level  and  is  the 
maximum  density  through  which  the  recording  medium  can  be  exposed.  The  clip  level  is 
logarithmically  proportional  to  the  controllable  uniform  illumination  used;  thus  the 
effect  of  varying  the  illumination  is  to  move  the  value  up  and  down  on  the  axis  of 
Fig  .  1  (c)  . 

The  transmission  of  the  recording  medium  is  ideally  either  1  or  0  because  of  its  high 
contrast  cha racter ist ics .  The  halftoned  version  of  a  continuous  density  distribution  such 
as  in  Fig.  1(a)  will  appear  as  shown  in  Fig.  1(e).  All  values  of  x  for  which  tne  density 
is  less  than  the  clip  level  turn  black  and  hence  transmit  no  light.  All  values  of  x  for 
which  the  density  is  greater  than  the  clip  level  do  expose  the  medium,  resulting  in  unity 
transmission . 

It  is  this  halftoned  picture,  as  shown  in  profile  in  Fig.  1(e),  which  is  capable  of 
yielding  a  nonlinearity  when  placed  in  a  coherent  optical  system  as  shown  in  Fig.  2.  If 
this  halftoned  input  picture  is  made  with  a  two-dimensional  halftone  screen,  the  Fourier 
transform  plane  is  a  two-dimensional  array  of  points  of  light  whicn  will  ideally  be  tne 
centers  of  distinct  3pectral  islands,  eacn  of  which  contains  complete  image  information. 
This  assumes  that  tne  picture  is  sampled  at  a  adequately  hign  rate.  If  the  sampling  rate 
is  not  high  enough,  the  spectral  islands  will  not  be  separable,  and  aliasing  will  occur. 
One  of  these  diffraction  orders  is  selected  by  a  spatial  filter  and  retransformed  by  the 
second  lens  to  yield  the  demodulated  output.  Tne  output  will  be  a  nonlinear  version  of 
the  original  picture,  where  the  nonlinearity  depends  on  the  nalftone  screen  and  the 
diffraction  order  cnosen. 

Several  references  [39-41]  consider  in  detail  the  dependence  of  the  system  transfer 
function  on  tne  nalftone  screen  and  diffraction  order  used.  Input-oucput  relationsn ips 
are  established  as  a  function  of  system  parameters,  and  many  numerical  examples  for  useful 
point  nonl inear i ties  are  given.  Some  experimental  resjlts  for  these  nonlinear  functions 
are  given  in  Sect.  2.2.  Additional  variations  in  the  halftone  screens  are  possible;  using 


nonmonotonic  cell  profile  functions  f(x)  allows  a  nonlinearity  witn  many  slope  Changes  to 
be  achieved  in  tne  first  diffraction  order  [42].  Related  design  algorithms  have  also  oeen 
given  by  Matsumoto  and  Liu  [43]. 


The  copy  medium  used  in  the  pulse-width  modulation  step  of  nonlinear  halftone 
processing  must  ideally  have  a  sharp  threshold  cnaracteristic.  Although  some  photographic 
materials  closely  approach  this  ideal,  tney  nave  tne  disadvantages  of  slow,  clumsy 
operation.  Recently,  many  different  types  of  real-time  optical  input  mooulators  nave 
appeared  which  can  convert  electronic  or  image  information  into  a  form  for  input  to  a 
coherent  optical  processing  system  [9,44-47).  Many  different  technologies  are  utilized  in 
these  devices,  but  at  present,  most  of  them  have  the  smooth,  linear  transfer 
characteristics  of  photographic  film  used  for  ordinary  continuous-tone  applications. 
Devices  which  operate  at  television  rates  (on  the  order  of  30  frames  per  second)  ano 
perform  snarp  thresholding  remain  unavailaDle.  Details  of  some  of  these  devices  anc 
experimental  results  for  nonlinear  processing  are  given  later. 

A  general  analysis  of  the  halftone  process  can  be  used  to  predict  the  effects  of  tne 
copying  medium  given  a  screen  profile  and  diffraction  order.  Several  analyses  of  tne 
problem  have  used  computer  simulation  to  predict  degradation  of  the  input-output  curves 
from  the  ideal.  The  results  of  this  work  are  extensive  [41,48];  only  a  sample  is  given 
here . 


For  smooth  monotonic  nonlinear  functions  such  as  the  logarithm,  tne  main  source  of 
output  degradation  is  the  linear  section  of  the  t  vs.  D^n  characteristic  curve  as  snown  in 
Fig.  3.  The  saturation  regions  where  the  slope  of  the  curve  is  zero  for  low  and  nigr. 
values  of  D^n  have  less  effect  on  the  performance.  Figure  4  snows  tnese  effects. 
Figure  4(a)  is  the  ideal  two  decade  logarithmic  response,  where  tne  horizontal  axis  is 
plotted  on  a  normalized  scale.  Figure  4(b)  shows  the  degraded  response  for  a  copying 
medium  having  a  photographic  gamma  (slope  of  the  linear  part  of  the  density  vs.  log 
exposure  curve)  of  3.0.  The  curve  showing  the  degradation  was  computed  using  a  piecewise 
linear  model  for  the  curve  g(.)  of  the  copy  medium,  although  any  particular  measured 
response  curve  can  be  used.  In  Fig.  4,  the  I0utresponse  tends  to  fall  below  ideal  for 
high  values  of  normalized  Iin. 

For  nonlinearities  with  sharp  slope  changes  and  sharp  corners,  such  as  the  level 
slice  function,  the  sharp  rising  and  falling  transitions  have  a  reduced  slope,  and  the 
sharp  corners  tend  to  become  rounded  [41].  The  reason  for  this  is  that  sharp  threshold 
functions  completely  rely  on  the  thresholding  characteristic  of  the  copy  medium  to  attain 
their  sharp  slope.  This  effect  can  be  seen  by  comparing  the  ideal  level  slice  shown  in 
Fig.  5(a)  with  the  degraded  results  shown  in  Fig.  5(b).  Given  a  copy  medium  with  a  finite 
gamma  greater  than  one,  it  is  possible  to  increase  the  effective  gamma  by  making  a  copy  of 
the  first  half toned  image.  The  overall  gamma  of  the  process  will  increase  and  tne 
threshold  will  be  sharper.  However,  this  procedure  is  clumsy  and  impractical  for 
real-time  implementation. 

The  results  of  computer  simulation  of  compensation  for  a  logarithmic  function  is 
shown  in  Fig.  4(c).  In  this  simulation,  30  discrete  points  in  the  halftone  screen  density 
profile  and  screen  density  values  from  0  to  2  are  assumed.  The  optimized  output  curve  is 
seen  to  approximate  the  ideal  result  in  Fig.  4(a)  with  much  less  error  tnan  before. 
Similar  results  for  a  level  slice  function  are  shown  in  Fig.  5(c).  Here  the  optimization 
procedure  is  successful  in  improving  the  fit  to  the  ideal,  but  cannot  increase  the  finite 
slope  on  the  sharp  transitions  at  the  boundaries  of  the  degraded  response.  Details  of 
these  procedures  and  many  additional  simulation  results  are  given  in  the  references 
[41,48]. 

2. 2  Experimental  results 

This  section  describes  experimental  results  on  nonlinear  processing  by  halftoning. 
The  first  section  summarizes  results  done  by  traditional  photographic  methods;  the  second 
section  describes  recent  real-time  implementation  with  coherent  input  transducers. 

2.2.1  Photographic  implementation 

The  use  of  halftoning  to  modify  gray  level  transfer  characteristics  dates  back  to  the 
late  1800 's  with  the  development  of  the  modern  graphic  arts  and  photographic  inaustry.  As 
early  as  1893  Abbe  [49]  experimentally  noted  the  diffraction  orders  present  in  tne  Courier 
spectrum  of  a  sampled  image.  More  recently,  Marquet  [SO]  and  later  Marquct  and  Tsujiucni 
[51]  noted  that  demodulating  a  halftoned  photographic  image  in  a  coherent  optical  system 
produced  various  monotonic  and  nonmonotonic  nonlinearities  depending  on  the  diffraction 
order  chosen  in  the  Fourier  transform  plane.  Similar  experiments  and  the  basic  idea  of 
halftoning  for  nonlinear  processing  were  given  by  Delingat  [52].  Other  halftone 
experiments  were  reported  by  Pappu,  Kumar  and  Mehta  [53],  and  Roychoudhuri  and  Malacara 
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[54]  explored  constrast  reversal  with  halftoning. 

Kato  and  Goodman  [36,37]  experimentally  found  that  a  commercially  available  halftone 
screen  performed  a  logarithmic  nonlinearity  over  two  log  units  of  exposure.  They 
demonstrated  the  use  of  the  technique  for  the  separation  of  multiplied  signals  by 
homomorphic  filtering.  In  homomorphic  filtering  the  logarithm  of  two  signals  which  have 
been  multiplied  is  taken  first.  This  log  operation  converts  the  signals  into  additive 
form  so  that  traditional  linear  filtering  can  be  used.  Homomorohic  filtering  is  effective 
for  separating  signals  with  a  multiplicative  noise  component.  Kato  and  Goodman 
demonstrated  its  application  in  separating  periodic  multiplicative  noise  from  an  image  as 
shown  in  Fig.  6.  Part  (a)  of  this  figure  shows  a  face  and  a  grating  mul tipi icativelv 
combined.  Part  (b)  shows  the  homomorphically  filtered  result  in  which  a  halftone  screen 
has  been  used  to  convert  the  input  into  additively  combined  signals  which  can  be  easily 
separated  with  Fourier  filtering.  Figure  6(c)  shows  the  result  of  pure  linear  filtering 
without  the  halftone  process  to  remove  the  grating.  They  describe  additional  experimental 
results  for  suppressing  speckle  noise  and  removing  the  screen  grid  from  radiographs. 
Dashiell  and  Sawchuk  [40]  also  made  logarithmic  halftone  screens  on  a  plotting 
microdensitometer.  These  screens  also  gave  a  good  approximation  to  a  logarithmic  response 
over  two  decades  of  input  dynamic  range.  Dashiell  and  Sawchuk  also  experimentally 
performed  exponentiation  having  an  output  dynamic  range  greater  than  three  decades. 

Dashiell  and  Sawchuk  have  experimentally  demonstrated  level  slicing  using  the  first 
Fourier  diffraction  order  as  described ‘in  references  [40,55].  Their  halftone  screen  was  a 
low  contrast  copy  of  a  Honchi  ruling.  Figure  7  shows  their  experimental  results;  part  (a) 
is  the  original  continuous  tone  scene  and  part  (b)  shows  the  isodensity  contours  of  level 
slicing. 

Much  early  work  on  halftone  nonlinear  processing  was  concerned  with  multiple 
isodensity  or  multiple  isophote  level  slicing.  Schwider  and  Burow  [56]  described  a 
technique  for  filtering  an  image  hologram  to  obtain  isophotes.  Delingat  [57]  showed  that 
passing  high  diffraction  orders  of  a  halftoned  image  produced  isophotes.  Schneider  [58] 
and  Schneider,  Fink  and  Van  Der  Piepen  [59]  described  the  design  of  special  halftone 
screens  and  filtering  systems  to  obtain  isopnote  and  i30density  contours.  Liu,  Goodman 
and  Chan  [60]  have  also  demonstrated  multiple  isophote  contours  by  filtering  a  halftoned 
image.  Figure  3  taken  from  Strand  [33]  shows  an  example  of  multiple  isophote  processing. 
Figure  3(a)  shows  the  input  image  and  Fig.  3(b)  shows  three  isophotes,  each  representing  a 
doubling  of  the  input  amplitude. 

Dashiell  and  Sawchuk  [42]  have  demonstrated  optical  image  quantization  and  intensity 
notch  filtering  by  halftoning.  They  described  a  synthesis  procedure  for  halftone  cell 
profiles  that  are  not  monotonic.  Using  such  a  screen,  they  can  achieve  ari  arbitrary 
number  of  sign  changes  in  the  input-output  curve  using  the  first  diffraction  order. 

Lohmann  and  Strand  [61]  and  Liu  [62]  have  performed  analog-to-dig ital  (A/D) 
conversion  by  halftoning  using  photographic  film.  Figure  9  from  Ref.  [61]  shows  a  three 
bit  A/D  output.  The  results  of  the  conversion  appear  serially  as  bit  planes,  each  of 
which  displays  the  information  of  a  particular  significant  bit  of  the  digitized  image. 
The  solid  lines  plotted  on  the  Iin  axis  of  the  figure  show  the  nonlinear  transfer 
characteristic  needed  to  produce  the  bit  planes  of  the  three-bit  reflected  binary  or  Gray 
code.  The  bottom  curve  showing  Iqj  vs.  I^n  is  the  least  significant  output  bit.  The 
halftone  process  was  used  and  the  output  results  are  shown  scaled  and  superimposed  on  the 
drawing.  Io2*  the  next  most  significant  bit,  has  the  same  characteristic  curve  as  I03 
except  that  the  horizontal  axis  is  expanded  by  a  factor  of  two.  This  expansion  is 
achieved  experimentally  by  attenuating  the  input  by  two  and  repeating  the  experiment. 
Similarly,  Iqi  is  the  most  significant  bit  and  it  is  obtained  by  attenuating  by  a  factor 
of  four.  In  this  way,  each  bit  can  be  obtained  sequentially  by  halftoning,  and  any  analog 
input  on  tne  scale  from  0  to  3  gives  a  unique  three-bit  quantized  and  digitized 
representation.  Results  of  A/D  conversion  on  a  two-dimensional  image  are  shown  in 
Figs.  10  and  11  [63].  Figure  10  is  the  input  image.  Figure  11  shows  the  Gray  code  bit 
planes.  The  images  on  the  left  3ide  of  Fig.  11  were  generated  by  the  optical  a/D 
conversion.  3it  planes  produced  by  a  scanning  microdensitometer  are  shown  on  tne  right 
side  of  Fig.  11  for  comparison.  The  discrepancies  near  the  perimeter  of  the  image  in  the 
least  significant  bit  are  attributable  to  nonuniform  illumination  in  the  optical 
processor. 

Liu  [62]  has  designed  a  halftone  screen  wnich  produces  several  bit  planes  with  only 
one  halftoned  photograph.  The  different  bit  planes  in  decreasing  order  of  significance 
are  obtained  by  passing  higner  order  diffraction  terms  in  the  Fourier  filtering  step.  Liu 
[64]  has  also  described  another  halftone  procedure  for  A/D  conversion  which  relies  on  an 
electronic  logic  array  to  produce  the  digital  output  at  each  image  point.  A  photograpnic 
halftone  procedure  is  used  first  as  a  quantizer  to  give  a  discrete  input  to  tne  logic 
system . 


2.2.2  Real-time  implementation 

There  has  been  very  little  experimental  work  on  real-time  nonlinear  halftone 
processing  because  of  the  lack  of  real-time  optical  input  transducers  with  a  thresnolo 
characteristic.  Logarithmic  and  level  slice  nonlinear  processing  has  been  attempted  with 
a  standard  Hughes  liquid  crystal  light  valve  (LCLV)  suitable  for  linear 
incoherent-to-coherent  optical  conversion. 

The  LCLV  exists  in  both  electronically  and  optically  controlled  versions.  The 
optical  LCLV  serves  as  a  real-time  incoherent-to-coherent  converter.  Incoherent  light 
impinges  on  a  photoconductor,  which  in  turn  changes  the  local  electric  field  across  a 
liquid  crystal  layer.  The  change  in  electric  field  alters  the  local  birefringence  of  the 
liquid  crystal  material.  This  birefringence  pattern  can  be  read  out  as  a  spatial 
amplitude  modulation  by  placing  an  analyzer  in  the  output  beam  oriented  orthogonal  to  the 
initial  polarization  of  the  readout  beam.  The  readout  illumination  can  be  spatially 
coherent  or  incoherent,  but  must  be  temporally  narrowband.  Additional  variations  in  the 
device  response  are  possible  by  introducing  a  twist  in  the  alignment  of  the  liquid  crystal 
molecules  during  device  assembly.  The  LCLV  device  operates  at  television  frame  rates 
(approximately  30  ms.  cycle  time)  and  generally  is  designed  to  have  a  linear  response  over 
two  decades  of  dynamic  range.  Many  references  that  discuss  construction  and  operational 
details  are  available  [44,45,47]. 

To  obtain  a  real-time  logarithmic  nonlinearity  [41],  the  characteristic  curves  of  a 
Hughes  45°  twisted  nematic  LCLV  were  measured.  Figure  12(a)  is  tne  original 
characteristic  curve  of  the  LCLV,  showing  that  the  device  has  a  smooth  curve  approximately 
that  of  photographic  film  with  a  gamma  of  2  to  3.  Using  this  data,  an  optimum  compensated 
discrete  halftone  screen  was  made  using  the  procedure  outlined  in  Ref.  [41].  This 
halftone  screen  had  a  fundamental  spatial  frequency  of  3  cycles/mm,  and  was  designed  to 
work  in  the  zero  diffraction  order. 

The  experimental  setup  used  is  shown  in  Fig.  13.  The  continuous  level  input  is 
placed  in  contact  with  the  halftone  screen  and  imaged  onto  the  control  surface  of  the  LCLV 
with  incoherent  illumination.  The  LCLV  is  read  out  with  coherent  light  between  crossed 
polarizers  and  a  pinhole  spatial  filter  is  placed  in  the  zero  order  in  the  Fourier  plane 
of  the  system.  Figure  12(b)  shows  the  response  curve  of  the  system  with  the  halftone 
screen  in  place.  The  result  approximates  a  logarithmic  transfer  function  with  less  than 
5%  error  over  one  decade  and  less  than  10%  error  over  two  decades. 

To  test  the  effectiveness  of  the  logarithmic  filtering  system  in  another  experiment, 
two  crossed  multipl icativel'y  combined  Ronchi  rulings  were  used  as  an  input  picture  for  the 
experimental  setup  of  Fig.  13.  The  period  of  these  rulings  was  approximately  3  mm,  much 
higher  than  the  halftone  screen  period  of  0.33  mm.  The  spectrum  in  the  filter  plane  is 
shown  in  Fig.  14(a).  Next,  the  logarithm  halftone  screen  was  placed  in  contact  with  the 
rulings.  The  filter  plane  spectrum  is  shown  in  Fig.  14(b).  The  difference  in  Fourier 
spectra  between  multiplicatively  combined  gratings  and  additively  combined  grating 
obtained  by  real-time  logarithmic  filtering  is  as  follows:  the  additive  spectrum 
components  lie  only  on  the  x  and  y  axis  around  the  zeroth  diffraction  order  in  the 
frequency  -  domain  while  the  multiplicative  spectrum  contains  cross-term  off-axis 
components.  Figure  14  also  shows  the  higher  diffraction  orders  that  arise  due  to  the 
halftone  screen.  For  simple  logarithmic  processing,  these  higher  orders  would  be 
eliminated  by  spatial  filtering. 

The  system  has  also  been  applied  to  an  image  filtering  problem.  For  this  experiment 
a  picture  with  multiplicative  noise  was  generated.  The  goal  was  to  eliminate  the 
multiplicative  noise  by  homomorphic  filtering;  i.e.,  a  sequence  of  a  logarithmic 
transformation  followed  by  linear  filtering.  Ideally,  this  would  be  followed  by  an 
exponential  transformation  but  this  is  not  essential  in  demonstrating  noise  reduction 
[41].  The  exponentiation  was  not  included  in  the  following  experiments.  The  noise 
generated  for  this  experiment  models  that  of  a  push-broom  scanner  that  scans  six  lines  at 
a  time  with  six  independent  detectors.  Any  variation  in  the  sensitivity  or  gain  along  the 
row  of  detectors  gives  rise  to  a  periodic  six-bar  noise  structure  across  the  image.  This 
effect  is  shown  in  Fig.  15(a).  The  density  range  of  the  image  with  the  simulated  scanner 
noise  was  2.0D.  This  was  chosen  to  match  the  100:1  operating  range  of  the  halftone 
screen. 

The  noisy  image  was  sandwiched  with  the  halftone  screen  and  imaged  with  incoherent 
illumination  onto  the  LCLV.  The  resultant  image  was  read  out  with  a  HeNe  laser.  A 
spatial  filter  was  placed  in  the  Fourier  plane  of  the  system  to  select  a  single  (zeroth) 
diffraction  order  in  the  halftone  spectrum.  Since  the  screen  effectively  performs  a 
logarithmic  transformation,  the  pattern  in  the  zeroth  diffraction  order  of  the  Fourier 
plane  consisted  of  the  sum  of  the  image  diffraction  pattern  and  the  push-broom  scanner 


diffraction  pattern.  The  scanner  diffraction  pattern  consisted  of  a  series  of  isolated 
diffraction  orders  which  could  be  filtered  out  without  significantly  degrading  the  image. 
Thus  in  the  output  plane  the  image  is  reconstructed  without  the  multiplicative  noise. 
This  is  shown  in  Fig.  15(b).  Without  the  logarithmic  transformation,  the  noise  and  image 
spectra  would  have  been  convolved  with  one  another  making  them  Impossible  to  separate. 

These  experiments  demonstrate  the  feasibility  of  performing  real-time  nonlinear 
filtering  for  smooth  functions  using  an  LCLV  or  other  real-time  device.  A  real-time  level 
slice  experiment  has  also  been  performed  with  a  standard  linear  45°  twisted  nematic  LCLV 
[65]  and  the  results  are  comparable  to  the  degraded  level  slice  work  shown  in  the 
simulations  of  Fig.  5(b).  Until  sharp  threshold  real-time  devices  become  available, 
halftone  nonlinear  processing  will  be  limited  to  smooth  nonlinear  functions. 

2.3  Extensions  and  conclusions 

Several  extensions  of  nonlinear  processing  useful  in  image  manipulations  have  been 
reported  experimentally.  Fseudocoloring  is  the  process  of  associating  colors  with 
different  gray  levels  in  a  monochrome  image  so  the  image  is  enhanced  for  display.  One 
motivation  for  the  use  of  pseudocolor  is  that  the  human  eye  is  much  more  sensitive  to 
small  changes  in  color  than  to  small  changes  in  gray  level.  The  pseudocoloring  system 
described  by  Liu  and  Goodman  [66]  begins  by  halftoning  the  continuous  tone  input  using  a 
screen  designed  to  produce  multiple  isophotes  [60].  The  halftoned  image  is  then  placed  in 
a  coherent  processor  as  shown  in  Fig.  2  and  is  sequentially  illuminated  by  red,  green  and 
blue  monochromatic  collimated  plane  waves.  Different  diffraction  orders  may  be  selected 
at  each  wavelength,  and  the  resulting  images  for  each  color  are  summed  photographically  on 
color  film  at  the  output.  The  result  contains  different  combinations  of  the  three  primary 
colors  at  each  point  as  a  function  of  input  level. 

Indebetouw  [67]  has  described  a  pseudocoloring  system  which  combines  halftoning  with 
elements  of  the  theta  modulation  procedure  discussed  in  Sect.  3.  A  one-dimensional 
halftone  screen  designed  to  produce  a  level  slice  is  used  in  contact  with  the  continuous 
tone  input  to  expose  a  high  contrast  film  as  usual.  This  process  is  repeated  with  the 
exposure  changed  so  that  the  effective  position  of  the  level  slice  on  the  Ijn  axis  is 
shifted.  In  addition,  the  one-dimensional  screen  is  rotated  through  a  small  angle  between 
exposures.  In  effect,  the  various  level  slices  are  encoded  as  directional  information  on 
the  binary  copy  film.  The  copy  film  is  then  placed  in  a  coherent  processor,  except  that  a 
white  light  point  source  is  used  in  front  of  the  collimating  lens  to  produce  white  light 
plane  wave  illumination.  In  the  Fourier  plane,  level  slice  information  recorded  at  a 
particular  range  of  intensity  values  appears  as  a  line  of  diffraction  spots  located  at  a 
unique  angle.  This  pattern  is  modified  with  an  angular  array  of  color  filters.  After 
inverse  transforming,  the  desampled  image  has  various  colors  associated  with  different 
bands  of  gray  levels.  An  advantage  of  this  method  is  that  the  colored  result  is  not 
formed  sequentially  and  need  not  be  summed  photographically  on  color  film. 

The  preceding  principles  and  experimental  results  are  a  summary  of  the  present  state 
of  halftone  nonlinear  processing.  The  procedure  allows  a  large  variety  of  nonlinear 
functions  to  be  performed,  but  also  has  limitations.  Two  major  limitations  are  that 
accurate  halftone  screens  with  sufficient  gray  level  resolution  must  be  available,  and 
that  a  sharp  threshold  is  needed  on  the  copy  medium  (photographic  film  or  real-time 
device)  to  ensure  a  binary  input  to  the  processor.  The  copy  medium  must  also  have  a 
spatial  resolution  sufficient  to  record  the  finest  detail  in  a  sampled  halftoned  image  of 
the  original.  Closely  related  to  this  is  the  tradeoff  between  spatial  resolution  in  the 
copy  medium  and  gray  scale  accuracy  in  the  final  output  due  to  the  pulse-width  modulation 
nature  of  the  process.  In  short,  the  overall  performance  of  nonlinear  halftone  processing 
depends  strongly  on  the  binary,  high  resolution  character  of  the  copy  medium.  These 
properties  can  generally  be  achieved  in  photographic  processes  but  are  still  unavailable 
in  a  real-time  optical  input  transducer.  A  final  limitation  is  noise  in  the  form  of 
speckle,  interference  fringes  and  other  artifacts  that  appear  in  coherent  systems. 
Careful  precautions  must  be  taken  to  avoid  these  effects.  Finally,  nonlinear  processing 
using  halftoning  and  incoherent  spatial  filtering  is  possible,  in  exactly  the  same  way  as 
the  eye  views  a  halftoned  photograph.  This  procedure  eliminates  coherent  noise  problems, 
but  is  limited  to  monotonic  nonlinear  transformations  of  intensity.  Achieving 
nonmonotonic  functions  requires  the  interference  properties  of  coherent  light. 


3.  Intenslty-to-spatlal  frequency  conversion 


One  very  convenient  method  of  obtaining  point  nonlinearities  is  through 
intenslty-to-spatlal  frequency  conversion.  The  idea  is  to  encode  each  resolution  element 
of  an  image  with  a  grating  structure  where  the  period  and/or  the  orientation  of  the 
grating  is  a  function  of  the  image  intensity  at  the  point  in  question.  Assuming  certain 
sampling  requirements  are  met,  each  intensity  level  of  interest  is  uniquely  assigned  to  a 
different  point  in  Fourier  space  and  all  points  with  a  given  intensity  in  the  image  are 


assigned  to  the  same  point  in  Fourier  space  (assuming  space- invar iant  operation  is 
desired).  Tnen  a  pure  amplitude  spatial  filter  can  alter  trie  relative  intensity  levels  in 
ar.  arbitrary  way.  The  overall  transformation  can  be  found  grapnically  as  shown  in  Fig.  16 
which  shows  an  implementation  of  a  level  slice.  In  the  figure,  tne  quantity  s  is  usee  as 
a  generalized  spatial  frequency  coordinate.  In  terms  of  polar  spatial  frequency 
coordinates,  s  typically  varies  either  along  an  arc  of  constant  radius  p  or  along  a  radius 
of  constant  azimuth  6  (see  Fig.  17(b)  and  (c) ) .  Tne  first  case  is  referred  to  as  tneta 
modulation  and  the  latter  case  is  referred  to  by  the  somewhat  ambiguous  term,  frequency 
modulation.  In  both  theta  modulation  and  frequency  modulation  metnods  there  is  a  certain 
connection  between  the  number  of  intensity  levels  to  be  d isting uisned ,  the  bandwiatn  of 
the  object,  and  the  spatial  frequency  required  for  the  modulated  grating.  For  the  general 
case  of  intensity-to-spatial  frequency  conversion,  the  spatial  frequency  is  mooulated 
along  some  arbitrary  curve  s  in  the  spatial  frequency  plane  (see  Fig..  17(a)).  a  grating 
with  a  given  fundamental  frequency  (c,6)  in  polar  coordinates,  corresponding  to  a  specific 
input  intensity,  produces  a  diffraction  order  at  (c,f)  surrounded  by  a  diffraction  spot 
whose  dimension  is  roughly  equal  to  the  bandwidth,  B,  of  the  ooject.  If  one  wants  to 
process  N  distinct  intensity  levels,  then  the  curve  s  must  De  choser.  so  that  K 
non-overlapping  object  spectra  can  be  placed  along  s  as  indicated  in  Fig.  17.  For  tneta 
modulation  and  for  frequency  modulation,  this  requirement  sets  a  lower  limit  for  p0,  the 
lowest  fundamental  frequency  of  the  modulation.  In  fact,  a  rough  calculation  shows  that 
o0  must  be  on  the  order  of  N*B  or  larger,  i.e.,  the  lowest  modulation  frequency  must  be 
larger  than  the  product  of  the  image  bandwidth  and  the  number  of  gray  levels.  Obviously, 
if  N  is  large,  very  high  spatial  frequency  gratings  will  be  required  which  is  a  limiting 
factor  in  these  techniques.  This  would  particularly  be  true  if  the  optical  system  nab  to 
be  capable  of  imaging  these  gratings.  Fortunately,  since  spatial  filtering  of  the  grating 
spectra  to  select  a  single  diffraction  order  is  an  integral  part  of  the  process,  the 
space-bandwidth  product  requirements  on  the  optical  system  are  not  so  severe. 

3. 1  Non-real-tiroe  implementation 

Of  these  two  intensity-to-spatial  frequency  conversion  techniques,  theta  modulation 
was  the  first  to  be  discussed  and  demonstrated  [68,69).  A  practical  problem  associated 
with  theta  modulation  as  well  as  with  frequency  modulation  is  how  to  obtain  the  spatial 
frequency  encoding.  One  solution  to  this  problem  for  theta  modulation  which  has  oeen 
demonstrated  involves  the  use  of  special  halftone  screens  [59].  The  screen  profile  is 
designed  to  produce  halftone  dots  which  have  one  edge  whose  orientation  is  a  function  of 
the  intensity  in  the  original  image.  The  theta  modulation  technique  is  especially  well 
suited  to  white-light  image  processing  since  the  spectra  at  different  orientations  do  not 
overlap  as  they  would  in  general  for  a  pure  frequency  modulation  scheme.  The  pseudocolor 
system  of  Indebetouw  [67]  described  in  the  previous  section  also  uses  halftone  techniques 
to  achieve  theta  modulation. 

Lee  has  recently  described  a  system  which  utilizes  both  theta  modulation  and 
frequency  modulation  [34].  A  scanning  interferometric  system  is  used  to  encode  each 
picture  element  of  an  image  as  a  small  grating  segment  whose  frequency  and  orientation  can 
be  changed  in  accordance  with  input  Intensity  levels.  If  real-time  processing  is  not 
required,  this  system  has  the  advantage  of  being  able  to  more  fully  utilize  the  Fourier 
plane  than  either  theta  modulation  or  frequency  modulation. 

3. 2  Real-time  implementation 

Frequency  modulation  has  recently  become  a  potentially  viable  means  of  achieving 
point  nonlinearities  in  real-time  with  the  advent  of  a  device  referred  to  as  a 
variable-grating-mode  (VGM)  liquid  crystal  device  [70,71).  The  VGM  device  consists  of  a 
thin  (<12um)  nematic  liquid  crystal  layer  sandwiched  with  a  photoconductor  between  two 
electrodes  (see  Fig.  18).  If  a  DC  voltage  is  applied  across  the  liquid  crystal,  a  pnase 
grating  structure  is  produced  in  the  liquid  crystal  material.  As  the  voltage  is  varied 
the  period  of  the  grating  structure  is  altered,  as  shown  in  Fig.  16.  As  seen  in  Fig.  19 
the  fundamental  frequency  of  the  grating  structure  can  typically  be  varied  between  20C  and 
600  lp/mm.  Since  the  voltage  across  the  liquid’  crystal  can  be  locally  controlled  by- 
projecting  an  image  onto  the  photoconductor,  the  device  functions  as  an 
intensity-to-spatial  frequency  converter.  The  attractive  aspects  of  this  device  are  that 
it  can  operate  in  real-time  and  it  is  a  parallel  processing  device.  Furthermore  many 
useful  nonlinearities  can  be  implemented  with  very  simple  filters.  For  example,  a  level 
slice  operation  is  obtained  by  placing  a  slit  in  tne  Fourier  plane  passing  only  a  narrow 
spatial  frequency  band  corresponding  to  a  given  input  intensity  range.  The  level  slice 
can  be  continuously  varied  by  merely  translating  the  slit  filter.  The  level  slice 
function  has  been  demonstrated  with  the  VGM  device  [72], 


The  VGM  device  is  still  very  much  in  the  development  stage.  There  are  many  problems 
to  be  solved  before  the  device  could  be  considered  as  a  practical  element  of  an  optical 
processing  system.  Principal  among  the  problems  is  one  of  defects  in  the  grating 


structure  as  seen  in  Fig.  20.  These  detects  cause  the  diffraction  orders  of  the  grating 
to  smear.  As  can  be  easily  deduced  from  the  earlier  analysis,  any  smearing  of  the 
diffraction  orders  reduces  the  number  of  distinct  intensity  levels  which  can  be  processed. 
Therefore,  it  is  necessary  to  keep  the  defects  at  a  minimum  if  one  wishes  to  process  an 
imaqe  with  a  large  number  of  intensity  levels.  Another  important  question  wnich  remains 
to  be  answered  is  the  speed  of  the  VGM  device.  Although  current  devices  are  slow  and,  due 
to  the  nature  of  the  device,  it  is  unlikely  that  high  speeds  could  ever  be  attained,  the 
goal  of  attaining  speeds  approaching  television  frame  rates  would  provide  an  adequate 
processing  rate  due  to  the  parallel  operation  of  the  device.  Other  areas  that  are  being 
studied  concern  such  issues  as  device  lifetime,  uniformity  and  reproducibility.  It  is 
expected  that  a  better  understanding  of  the  underlying  physics  of  the  VGM  effect  will  have 
a  significant  impact  on  all  the  problem  areas  discussed. 

One  application  area  of  nonlinear  processing  which  is  of  great  general  interest  and 
which  is  of  particular  interest  for  work  with  current  VGM  devices  is  the  implementation  of 
optical  logic  [73].  Figure  21  shows  how  logic  operations  can  be  viewed  as  simple  point 
nonlinearity  operations.  This  figure  assumes  that  two  binary  inputs  are  superimposed  on  a 
device  and  indicates  the  nonlinear  response  required  to  obtain  various  combinatorial  logic 
functions.  It  is  seen  that  the  required  nonlinearities  are  simple  binary  functions. 
These  functions  are  particularly  well-suited  to  VGM  devices  in  principle  since  the  desired 
nonlinearities  can  be  obtained  by  simple  slit  apertures  in  the  Fourier  plane  of  the  VGm 
device.  The  logic  functions  are  also  well-suited  to  the  practical  limitations  of  current 
devices  because  there  are  only  a  small  number  of  intensity  levels  that  need  to  be 
distinguished  in  a  logic  system.  This  in  turn  implies  that  defect-broadened  diffraction 
orders  can  be  tolerated. 

Of  course  the  interest  in  performing  logic  operations  optically  is  again  due  to  the 
processing  advantage  of  a  parallel  processing  system.  Each  resolution  element  of  the 
processing  system  functions  as  an  independent  logic  gate  and  all  resolution  elements  are 
processed  simultaneously.  Thus  even  an  Inherently  slow  device  can  provide  a  high 
effective  data  processing  rate.  Furthermore,  if  the  data  to  be  processed  are  initially  in 
the  form  of  an  image,  having  a  parallel  optical  processor  can  obviate  the  need  for 
scanning  and  serializing  the  data.  Given  an  analog  image,  one  still  needs  to  perform  an 
analog-to-dig ital  (A/D)  conversion,  but  that  can  also  be  done  in  parallel  optically, 
either  with  a  VGM  device  or  with  other  nonlinear  techniques  discussed  in  this  chapter 
[61,74]. 

Figure  22  shows  how  a  VGM  device  could  be  used  to  perform  two-input  combinatorial 
logic  functions.  The  two  binary  inputs  are  imaged  onto  a  transparent  photoconductor. 
This  may  be  a  completely  incoherent  imaging  process.  A  spatially  coherent  readout  beam  is 
passed  through  the  device.  The  read  and  write  beams  in  this  setup  should  be  such  that 
they  can  be  separated  either  with  a  spatial  filter  or  a  color  filter.  A  slit  aperture 
placed  in  the  Fourier  plane  is  used  to  implement  the  desired  logic  operation.  Experiments 
were  conducted  using  two  inputs  which  were  chosen  such  that  the  output  would  be  in  the 
format  of  a  truth  table.  The  results  are  shown  in  Fig.  23.  In  these  experiments  the 
image  area  was  approximately  1  cm*.  The  images  are  written  with  a  filtered  Hg-arc  lamp. 
An  optical  bias  in  the  form  of  a  uniform  background  illumination  was  included  so  that  the 
zero  input  condition  would  correspond  to  a  non-zero  VGM  frequency.  This  offset  is 
necessary  for  implementing  the  NOT  function  or  any  other  function  requiring  a  non-zero 
output  for  a  zero  input.  The  image  was  read  out  with  a  collimated  HeNe  laser  beam. 

Not  only  can  one  implement  the  basic  combinatorial  logic  functions  with  this  system, 
but  one  can  obtain  any  commutative  boolean  function  with  a  single  pass  through  the  system. 
Thus,  for  example,  a  full-adder  can  be  implemented  directly  with  a  single  device.  Indeed 
since  the  VGM  device  produces  a  symmetric  spectrum,  one  can  filter  the  positive 
diffraction  orders  to  obtain  the  sum  bit  of  a  full  adder  and  simultaneously  filter  the 
negative  orders  to  obtain  the  carry  bit.  The  experimental  setup  for  realizing  a 
fuli-adder  which  simultaneously  operates  on  all  points  of  one  image  bit-plane  is  snown  in 
Fig.  24. 


By  adding  feedback  to  the  system,  it  is  possible  to  extend  this  technique  to 
sequential  logic.  Furthermore,  if  a  means  can  be  devised  of  interconnecting  the  pixels  on 
a  given  device,  one  can  construct  entire  circuits  on  a  single  VGM  device. 

It  should  be  noted  in  closing  this  discussion  that  even  if  the  VGM  device  itself  does 
not  prove  to  be  a  practical  optical  processing  component,  the  concept  of  having  an  element 
wnich  performs  a  two-dimensional  intensity-to-spatiai  frequency  conversion  in  real  time  is 
so  powerful  that  it  warrants  research  into  other  possible  means  of  achieving  that 
f  unction . 
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4 .  D i rect  nonlinearities 


Direct  nonlinear  optical  functions  are  achieved  using  the  inherent  nonlinear  transfer 
characteristics  of  an  optical  recording  medium  or  real-time  image  transducer,  nitu  tnis 
type  of  nonlinear  processing,  there  is  no  pulse-widtn  modulation,  intensity-to-spatial 
frequency  conversion  or  other  type  of  intermediate  mechanism.  Thus  tnese  techniques  offer 
the  potential  of  simple  systems  that  avoid  the  noise  problems  associated  witn  many  optical 
filtering  techniques  and  have  much  less  stringent  space-bandwidtn  product  requirements 
than  systems  which  must  modulate  the  input  data. 

4 . 1  Photographic  implementation 

Photographic  film  has  been  used  since  its  invention  to  perform  nonlinear  image 
transformations.  Although  most  photography  uses  the  linear  part  of  the  oensity  vs.  log 
exposure  curve  to  ensure  linear  recording,  the  limiting  characteristics  of  the  saturation 
region  of  the  film  curve  and  the  nonlinear  curve  (toe)  rising  to  the  linear  region  nave 
been  used  for  artistic  and  scientific  effect.  Tai  et  al.  [75]  have  obtained  a  direct 
logarithm  by  carefully  choosing  operating  points  on  the  characteristic  curves  of  film.  A 
two  film  procedure  with  a  copying  step  is  used,  and  a  dynamic  range  of  two  decades  is 
obtained  without  the  need  for  a  halftone  screen.  They  have  applied  tnis  procedure  for 
homomorphic  filtering  of  multiplied  signals,  with  results  comparable  to  those  shown  in 
Fig.  6. 

Agfa  [76]  has  produced  a  special  photographic  product  called  Agfacontour  containing  a 
sandwich  of  positive  and  negative  emulsions.  This  combination  gives  the  film  a  direct 
level  slice  characteristic  which  produces  an  isodensity  contour  output. 

4. 2  Real-time  implementation 

For  real-time  direct  nonlinear  processing,  television  systems  and  solid-state  sensor 
arrays  combined  with  electronic  scanning  and  nonlinear  processing  circuitry  have  been  used 
for  nonlinear  processing.  The  characteristic  transfer  curves  can  be  electronically  shaped 
so  that  the  complete  system,  consisting  of  scanned  image  sensor,  processing  and  display, 
performs  a  desired  nonlinearity.  Because  of  the  scanned  nature  of  these  systems  however, 
the  parallel  processing  capabilities  of  optics  are  lost. 

A  real-time  optical  transducer  which  has  been  used  for  nonlinear  processing  is  the 
Itek  PROM  (Pockels  Read-Out  Optical  Modulator)  [46],  This  device  is  based  on  a  Bij^SiOzO 
crystal  which  is  both  birefringent  and  photoconductive .  The  PROM  is  sensitive  at  blue 
wavelengths  and  is  read  out  nondestructively  at  red  wavelengths  through  crossed 
polarizers.  By  altering  bias  voltages  in  a  particular  sequence  with  the  application  of  a 
control  image,  various  linear  operations  such  as  contrast  inversion  and  real-time  spatial 
wavefront  modulation  can  be  done.  Using  a  different  control  sequence  produces  an 
approximate  real-time  level  slice  effect.  PROM  devices  are  still  in  the  research  and 
development  stage,  but  their  flexibility  in  performing  linear  and  nonlinear  optical 
real-time  processing  makes  them  interesting  candidates  for  future  work. 

The  Hughes  liquid-crystal  light  valve  (LCLV)  described  earlier  in  Sect.  2.2.2  is 
another  real-time  device  that  has  been  applied  to  real-time  direct  linear  and  nonlinear 
processing  [45,47],  The  particular  characteristic  curves  of  such  devices  can  be  used  for 
direct  nonlinear  processing  in  real  time  in  exactly  the  same  way  as  photographic  film  witn 
the  choice  of  positive  or  negative  characteristic  curves.  An  example  of  this  is  a 
real-time  incoherent  image  subtractor  which  has  been  built  using  two  LCLV's  [77], 

A  direct  implementation  of  A/D  conversion  in  real-time  using  a  special  type  of  LCLV 
has  been  described  by  Armand  et  al.  [74],  The  system  performs  the  sampling,  quantization 
and  digitization  of  a  two-dimensional  data  array  without  scanning.  The  method  uses  the 
nonlinear  device  characteristics  of  a  special  LCLV  having  uniform  parallel  alignment  of 
the  liquid  crystal  material.  In  this  configuration,  the  device  exhibits  a  pure 
birefringent  effect  that  varies  with  local  electric  field  controlled  through  a 
photoconducting  layer.  The  special  LCLV  is  called  a  multiple  period  device;  the  overall 
relationship  between  the  intensity  transmittance  of  the  device  and  the  incident  intensity 
at  any  point  is  given  ideally  by  the  sinusoidal  curve  shown  with  dashes  in  Fig.  25(a). 

The  digital  results  of  A/D  conversion  at  each  image  point  may  be  output  serially  as  a 
bit  sequence  or  in  parallel  as  bit  planes  like  those  shown  in  Fig.  11.  The  solid-line 
curves  of  Fig.  25  show  the  nonlinear  transfer  characteristic  needed  to  produce  the  bit 
planes  of  the  three-bit  reflected  binary  or  Gray  code  and  their  relationship  to  the  dashed 
curves  of  sinusoidal  device  characteristics.  When  the  output  of  Fig.  25(a)  is  thresholdeci 
at  one  half,  a  1  output  is  produced  above  threshold  and  a  0  output  below,  as  shown  by  the 
curves  with  solid  lines.  This  thresholding  can  be  done  electronically  following  light 
detection  by  a  parallel  array  of  sensors.  The  threshold  output  in  Fig.  25(a)  is  the  least 
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significant  bit  of  the  three-bit  Gray  code.  The  other  two  bits  are  obtained  by 
attenuating  the  input  intensity  to  rescale  effectively  the  horizontal  axis.  Use  of  tne 
full  dynamic  range  (0  to  8)  gives  the  least  significant  bit.  Attenuating  the  input  by  a 
factor  of  1/2  (to  the  range  0  to  4)  gives  the  first  cycle  of  the  characteristic  curve 
shown  in  Fig.  25(bi.  The  last  (most  significant)  bit  is  obtained  by  using  an  attenuation 
of  one  fourth  so  the  curves  of  Fig.  25(c)  result.  Note  that  any  continuous  input  between 
0  and  8  gives  a  unique  quantized  three-bit  output.  Altnough  the  outputs  in  Fig.  25  are 
the  three  bits  of  the  Gray  code,  other  A/D  code  conversions,  such  as  the  usual  straight 
binary  code,  can  be  achieved  by  translating  these  curves  left  or  right  along  the 
horizontal  axis.  This  can  be  done  by  introducing  phase- retardation  plates  with  different 
delays  along  orthogonal  axes  into  the  crossed  polarizer  system. 

The  system  can  produce  these  bits  in  parallel  by  placing  an  array  of  three 
periodically  repeated  attenuating  strips  over  the  write  surface  of  the  liquid-crystal 
device,  as  shown  schematically  in  Fig.  26.  The  strips  have  attenuation  factors  of  1,  1/2, 
and  1/4,  and  the  image  of  the  strips  is  in  register  with  a  parallel  photodetector  array 
with  electronic  thresholding  in  the  output  plane.  All  three  bits  are  sensed  in  parallel 
in  this  way.  The  period  of  the  strips  should  be  much  smaller  than  the  inverse  of  the 
maximum  spatial  frequency  of  the  input  picture  to  avoid  aliasing.  A  two-dimensional  array 
of  attenuating  spots  with  a  corresponding  detector  array  can  also  be  used  instead  of  the 
linear  strip  array.  Simpler  but  slower  operation  can  be  achieved  by  using  only  one 
detector  array  and  sequentially  uniformly  attenuating  the  entire  input  array.  Ideas  such 
as  this  have  been  used  for  electro-optic  A/D  conversion,  but  none  have  used  an  optically 
controllable  real-time  device. 

The  experimental  system  shown  in  Fig.  27  was  used  to  obtain  the  input-output 
characteristic  of  the  pure  birefringent  LCbV  and  to  demonstrate  the  concept.  The 
incoherent  source  illuminating  the  input  plane  is  a  mercury-arc  lamp.  A  fixed  and 
rotatable  polarizer  pair  in  the  input-light  beam  is  used  to  vary  the  input-light 
intensity.  The  real-time  device  was  a  Hughes  parallel  aligned  nematic  LCLV  witn  a  CdS 
photoconductor.  The  short-wavelength  cutoff  filter  eliminates  wavelengths  shorter  chan 
493  nm  to  make  sure  that  the  write-beam  wavelength  is  matched  to  the  sensitivity  range  of 
the  CdS  photoconductor.  The  read  light  source  is  a  xenon-arc  lamp.  Because  of  the 
dispersion  of  birefringence  in  the  1 iquid-cry3tal  material,  the  read  light  should  have  a 
narrow  spectral  bandwidth.  An  interference  filter  with  a  peak  wavelength  of  434.7  nm  and 
a  bandwidth  of  18.4  nm  was  used  to  meet  this  requirement  for  the  read  light.  With  no 
picture  in  the  input  plane,  the  output  intensity  varies  in  a  quasi-sinuso idal  fashion  with 
increasing  input  illumination  because  of  the  changing  birefringence.  If  the  amount  of 
birefringence  varied  linearly  as  a  function  of  the  write-beam  intensity,  a  strictly 
sinusoidal  variation  of  the  output  intensity  would  be  expected.  However,  a  number  of 
factors,  including  the  optical  nature  of  the  liquid  crystal  and  the  photoconductor 
characteristic  properties,  affect  the  output  curve  and  produce  an  approximately  sinusoidal 
output  whose  frequency  varies  (monotonically)  with  input  intensity.  The  experimental 
response  curve  obtained  is  shown  in  Fig.  28. 

Although  the  theory  behind  the  A/D  conversion  assumes  a  strictly  periodic  response 
characteristic,  it  is  possible  to  produce  the  desired  bit  planes  by  using  the 
quas i-per iod ic  response  curves  of  the  actual  device.  The  tradeoff  is  that  nonuniform 
quantization  results.  The  quantization  levels  obtained  in  this  experiment  are  shown  in 
Fig.  28. 

There  are  no  attenuating  strips  on  the  liquid-crystal  device  used  in  this  experiment. 
Instead,  the  bit  planes  were  generated  serially.  Also,  the  output  was  recorded  on 
hard-clipping  film  rather  than  a  thresholding  detector  array.  A  test  target  was  generated 
that  consisted  of  an  eight-gray-level  step  tablet.  The  gray  levels  were  chosen  to  match 
the  quantization  levels  shown  in  Fig.  28.  This  test  object  was  imaged  onto  the 
liquid-crystal  device,  and  the  output  was  photographically  hard  clipped  to  produce  the 
least  significant  bit  plane  of  a  three-bit  A/D  conversion.  Next  the  write  illumination 
intensity  was  decreased,  effectively  rescaling  the  response  curve  of  the  device  to 
generate  the  next  bit  plane.  The  last  bit  plane  (most  significant  bit)  was  obtained  by 
attenuating  the  write  intensity  again  and  photographing  the  output.  The  input  and  the 
three  bit  planes  generated  are  shown  in  Fig.  29. 

Although  the  output  concains  some  noise,  the  experiment  illustrates  the  principle  of 
real-time  parallel  incoherent  optical  A/D  conversion.  It  was  found  later  that  the 
computer-generated  gray  scale  was  somewhat  noisy  because  of  the  grain  of  tne  nigh-contrast 
film  used.  It  is  possible  that  future  experiments  witn  clearer  inputs  and  improved 
periodic  light  valves  could  produce  better  experimental  results  and  more  bits  of 
quant i za t ion . 

The  potential  A/D  conversion  rate  can  be  estimated  from  typical  parameters  of 
currently  available  devices.  The  important  parameters  are  device  resolution  (typically  40 
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cvcles/mm),  device  size  (typically  50  mm  x  5C  mm),  and  speed  (generally  30  frames  per 
second).  Multiplying  all  these  parameters  together  and  dividing  by  3  for  the  attenuating 
strips  implies  an  A/D  conversion  rate  of  4  x  10'  points  per  second.  A  fully  parallel 
system  with  one  light  valve  and  detector  array  for  each  bit  plane  could  achieve  1.2  x  10® 
points  per  second. 

An  advantage  of  this  technique  is  that  it  operates  with  incoherent  input.  The 
requirements  on  the  spatial  and  temporal  coherence  of  the  readout  illumination  are 
sufficiently  relaxed  that  noise  problems  associated  with  coherent  spatial  filtering  or 
transforming  techniques  are  avoided.  Tne  technique  also  minimizes  tne  spatial-frequency 
requirements  of  the  real-time  device  because  the  sharp  edges  of  the  binary  dots  in 
halftoning  do  not  have  to  be  maintained. 

Although  these  initial  results  are  encouraging,  further  application  of  the  tecnnique 
must  await  improved  real-time  devices.  The  aperiodic  nature  of  the  LCLV  results  ir. 
unequal  quantization  intervals  and  limits  the  number  of  bits.  The  LCLV  device  used  in 
this  experiment  is  inherently  aperiodic  because  of  the  nonlinear  response  of  the 
photoconductor  and  the  nonlinear  relationship  between  applied  voltage  and  effective 
birefringence.  Further  developments  in  device  technology  may  improve  the  periodicity  and 
overall  performance  of  the  technique. 

In  a  related  application  of  a  Hughes  birefringent  LCLV,  Collins,  Fatehi  and  Wasmundt 
[78]  have  implemented  binary  combinatorial  logic  operations  by  directly  using  the 
characteristic  curves  of  the  device.  They  have  achieved  two  input  logic  functions  sucn  as 
AND,  NOR,  XOR,  etc.  by  viewing  logic  as  a  nonlinearity  similar  to  the  procedure  followed 
in  the  VGM  logic  described  in  Sect.  3.2.  Their  LCLV  device  was  a  parallel  aligned,  pure 
birefringent  cell,  similar  to  that  used  by  Armand  et  al.  [74]  for  A/D  conversion.  By 
appropriate  choice  of  operating  point  on  the  device  curves  shown  as  dashed  lines  in 
Fig.  25  different  functions  are  achieved.  They  use  various  rotations  and  combinations  of 
polarizer/analyzer  pairs  to  translate  the  curves  left  and  right  to  match  the  desired 
characteristics.  Their  experimental  results  demonstrate  several  of  the  standard  binary 
combinatorial  logic  functions. 

Lee  and  coworkers  have  developed  a  system  for  obtaining  logic  operations  using  a 
liquid  crystal  optically  addressed  through  a  photoconductor  matrix  [33,34).  Each  element 
of  the  array  can  perform  simple  combinatorial  logic  operations  on  two  binary  inputs. 

As  noted  in  Sect.  2.1,  real  time  implementation  of  halftoning  is  limited  by  the  lack 
of  an  optical  input”  transducer  with  a  threshold  characteristic.  The  threshold  itself  is 
useful  as  a  direct  nonlinear  function;  for  example  the  nonlinear  curves  needed  for  optical 
logic  can  be  expressed  as  a  sequence  of  thresholds.  An  attempt  at  improving  the  threshold 
characteristics  of  the  Hughes  LCLV  has  been  described  by  Michaelson  [79).  a  feedback, 
arrangement  shown  in  Fig.  30  was  used.  As  shown  in  the  figure,  a  portion  of  the  output 
light  is  directed  back  to  the  input  of  the  light  valve  via  a  combination  of  beamsplitters 
and  lenses.  The  light  is  summed  with  the  input  illumination  at  the  surface  of  the  light 
valve  to  produce  positive  feedback.  Both  the  read  and  the  write  illumination  were  derived 
from  an  argon  ion  laser  operating  at  514.5  nm.  It  should  be  noted  that  although  coherent 
light  was  used  in  the  experimental  procedure,  the  feedback  arrangement  and  characteristics 
of  the  light  valve  are  such  that  incoherent  illumination  would  have  worked  as  well.  To 
avoid  unwanted  interference  between  the  coherent  input  light  and  the  feedback  light,  the 
input  illumination  was  configured  with  its  polarization  orthogonal  to  the  feedback 
component.  In  this  manner,  the  incident  light  on  tne  light  valve  was  simply  the  sum  of 
the  intensities  of  the  two  components.  In  the  initial  state,  with  no  input  illumination 
and  the  feedback  component  set  to  zero  by  momentarily  blocking  the  feedback  patn,  tne 
device  remains  in  the  off  state  resulting  in  zero  output  intensity.  As  the  input 
illumination  is  increased,  the  device  remains  off  until  the  threshold  level  of  the  light 
valve  is  reached.  At  this  point,  the  device  begins  to  turn  on  and  as  a  result  of  tne 
optical  gain  characteristic  of  the  light  valve  and  the  positive  feedback,  regeneration 
occurs.  The  device  is  switched  on  with  no  further  increase  in  input  illumination.  The 
regenerative  process  continues  until  a  point  is  reached  on  the  light  valve  transfer  curve 
where  the  loop  gain  (device  gain  less  the  feedback  losses)  drops  to  unity.  In  practice 
this  point  is  reached  before  the  saturation  level  of  the  light  valve  is  reached.  As  a 
result,  the  desired  binary  transfer  function  is  not  entirely  achieved  but  rather  a  soft 
shoulder  is  obtained  with  further  increase  in  input  illumination.  Experimental  results 
are  shown  in  Fig.  31  together  with  the  light  valve  transfer  function  for  comparison.  As 
seen  in  the  figure,  the  feedback  system  provides  a  very  sharp  threshold  characteristic  as 
well  as  a  marked  improvement  in  overall  gamma. 

The  light  valve  used  to  obtain  the  data  in  Fig.  31  did  not  exhibit  a  particularly 
high  gamma.  Thus  the  output  range  over  which  regeneration  occurred  was  somewhat  limited. 
Further,  device  nonuniformities  over  the  aperture  precluded  the  possibility  of  testing  tne 
feedback  arrangement  with  two-dimensional  input  images.  To  be  effective,  the  device  would 
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have  to  be  sufficiently  uniform  to  maintain  the  input  threshold  point  within  a  reasonably 
narrow  oand  over  the  area  of  the  input  image.  Improved  devices  exhibiting  both  the 
necessary  uniformity  and  increased  initial  gamma  could  render  the  feedback  system  a  viable 
means  of  obtaining  real-time  sharp  thresholding  operation  from  the  light  valves. 

In  a  related  system,  Sengupta,  Gerlach  and  Collins  [80]  have  used  feedback  around  a 
LCLV  to  implement  an  optical  flip-flop.  Pairs  of  image  elements  on  the  LCLV  are  coupled 
by  optical  feedback  so  that  latching  at  one  of  two  stable  states  occurs.  A  parallel  array 
of  flip-flops  is  achieved  with  one  LCLV  by  arranging  the  output  of  half  the  active  image 
area  to  control  the  opposite  half,  and  vice-versa.  They  present  stability  theory  to 
predict  the  stable  states  and  show  experimental  confirmation. 

Another  method  of  direct  nonlinear  processing  uses  several  optically  and  electrically 
controlled  liquid  crystal  light  valves.  This  system  has  been  described  in  detail  by 
Michaelson  and  Sawchuk  [81]  and  is  called  the  multiple  light  valve  system  (MLVS).  The 
system  performs  nonlinear  processing  in  real-time  and  has  the  advantages  of  inconerent 
operation  and  electronic  programming  of  arbitrary  nonlinearities. 

A  functional  schematic  of  the  MLVS  is  shown  in  Fig.  32.  The  first  element  in  the 
system  maps  the  intensity  variations  of  the  two-dimensional  input  image  into 
two-dimensional  outputs  with  constant  magnitude  and  temporal  separation.  This  step  is 
done  by  a  time-scanning  level  slice  produced  with  a  LCLV.  The  constant  magnitude  outputs 
are  then  weighted  as  a  function  of  time  by  another  LCLV  to  give  the  desired  nonlinear 
transformation.  The  weighted  outputs  are  then  integrated  over  an  appropriate  time 
interval  to  give  a  nonlinearity  transformed  output  image.  The  operation  is  shown 
schematically  in  Fig.  32  for  a  simple  three  intensity  level,  two-dimensional  input  image. 
The  intensity-to-time  converter  maps  input  intensities  over  the  range  of  0  to  1^  into 
the  time  interval  [0,T].  Thus  for  a  linear  mapping,  the  output  planesmfor  the 
intensity-to-time  converter  will  remain  dark  during  the  time  interval  0<t<ti  since  there 
are  no  intensity  components  in  the  input  image  between  I  »  0  and  I  *  lx .  At  time  t 
corresponding  to  the  input  intensity  1^,  the  output  plane  will  have  a  constant  intensity 
response  over  all  portions  of  the  input  image  for  which  I  *  I.  .  Similar  output  responses 
occur  at  times  t2  and  t3  as  shown  in  the  figure.  For  all  other  times  0<t<T  with 
t  t  tj,t2,tj  the  output  intensity  remains  at  zero.  The  temporal  intensity  weighter  is 
simply  an  electrooptic  attenuator  which  weights  the  constant  intensity,  time  sequential 
outputs  of  the  intensity-to-time  converter  in  the  desired  nonlinear  manner.  The  time 
sequential  weighted  responses  are  then  summed  over  the  interval  [ 0 , T]  in  the  integrator. 
Thus  at  time  t  =  T,  a  nonlinearly  transformed  input  image  will  be  present  at  the 
integrator  output.  A  simple  logarithmic  compression  is  depicted  in  Fig.  35.  In  practice, 
the  integrator  can  be  a  television  system,  photographic  film,  or  another  real-time  image 
transd ucer . 

One  of  the  key  features  of  the  system  is  the  ability  to  arbitrarily  change  the  form 
of  the  nonlinear  function  in  real  time.  The  nonlinearity  is  introduced  by  applying  a 
nonlinearly  shaped  voltage  waveform  into  the  temporal  intensity  weighter  during  the  time 
interval  [0 , T] .  In  the  system  being  evaluated,  the  waveform  is  produced  by  a 
microprocessor-D/A  converter  and  can  arbitrarily  be  changed  to  effect  numerous 
transformations  including  logarithm,  exponentiation,  level  slice,  and  A/D  conversion. 
Details  of  implementation  and  experimental  measurements  are  given  in  Ref.  [79,81]. 

Figures  33  and  34  show  operation  of  the  system  with  a  logarithmic  and  exponential 
cnaracteristic.  Figure  35(b)  shows  the  experimental  results  of  a  level  slice  operation 
performed  on  the  variable  intensity  input  image  of  Fig.  35(a). 

Farhat  [35]  has  discussed  the  possibility  of  using  a  photochromic  material  to 
implement  a  direct  nonlinearity.  In  particular,  he  suggests  the  possibility  of  performing 
division  optically  by  placing  a  transparency  in  contact  with  a  photochromic  material 
saving  a  negative  response  characteristic.  In  his  paper,  Farnat  also  suggests  several 
variations  of  composite  nonlinear  systems  obtained  by  placing  a  photochromic  nonlinear 
element  at  various  places  in  an  optical  processing  system 

A  final  tecnnique  for  direct  point  nonlinearities  has  been  developed  by  Santamaria  et 
al.  [32]  for  providing  a  square  root  nonlinearity.  The  method  does  not  fit  into  any  of 
the  three  rubrics  listed  above  under  point  nonlinearities.  The  method  consists  of  doing  a 
time-sequential  reconstruction  of  an  image  by  imaging  through  a  filter  that  transmits  the 
zero  order  and  one  other  spatial  frequency  component.  The  selection  of  the  second 
component  is  done  by  scanning  an  aperture  in  the  Fourier  plane. 

5.  Prospects  for  future  resea rch 

Finally,  a  few  words  about  future  directions  for  nonlinear  processing  and  optical 
processing  in  general  can  be  given.  One  of  tne  major  limitations  of  optical  processing  in 


comparison  to  digital  systems  is  the  limited  accuracy  available.  Closely  related  issues 
are  the  inherent  system  noise  and  dynamic  range;  in  fact,  accuracy  can  be  thought  of  as 
the  number  of  distinguishable  signal  levels  within  the  usable  dynamic  range.  For  analog 
optical  processing,  6  bit  accuracy  (64  levels)  is  moderately  difficult,  8  bit  accuracy 
(128  levels)  is  very  difficult,  and  10  bit  accuracy  (1C24  levels)  may  be  impossiole.  For 
the  human  observer,  6  bits  may  be  acceptable  for  the  final  output  of  an  image  processing 
system,  but  more  accuracy  may  be  needed  internally.  Digital  computers  can  have  internal 
processing  registers  of  64  bits  or  more,  so  that  their  accuracy  is  eventually  limited  by 
the  accuracy  of  the  sensors  which  convert  tne  analog  input  to  digital  form.  Accuracy, 
noise  and  dynamic  range  problems  become  more  serious  with  nonlinear  processing. 
Signal-independent  noise  becomes  signal-dependent,  more  internal  processing  accuracy  is 
needed  to  accommodate  larger  variations  in  signal  magnitude,  scaling  of  quantities 
internally  is  hard  to  predict,  and  analysis  of  these  effects  becomes  difficult. 
Experimental  and  theoretical  research  to  study  these  effects  is  needed,  particularly  in 
the  context  of  optical  processors. 

Research  on  optical  real-time  devices  with  novel  operations  and  threshold  benavior 
should  be  supported  in  the  future.  Devices  such  as  the  variable-grating-mode  (VGh) 
devices  [70,71]  that  perform  intensity-to-spatial  frequency  conversion  can  perform  analog 
nonlinear  processing  in  a  flexible  manner  and  also  can  perform  binary  or  residue  [22-28] 
arithmetic.  Research  on  VGM  devices  is  in  the  early  stages  and  very  little  thought  has 
been  given  to  the  application  of  this  new  type  of  element  in  optical  processors. 

Related  to  this  is  current  research  on  numerical  optical  processors  that  use 
different  number  systems  (binary  or  residue)  with  a  relatively  small  number  of 
well-defined  distinguishable  levels.  For  binary  systems,  the  base  is,  of  course,  2 
levels;  for  residue  systems  the  base  may  be  on  the  order  of  20.  To  perform  this  type  of 
optical  processing  in  real  time,  new  optical  devices  that  exhibit  threshold  behavior  must 
be  developed.  In  this  paper,  the  work  on  optical  logic  and  feedback  for  threshold 
sharpening  are  preliminary  efforts  in  this  direction.  Recent  work  on  microcnannel  plate 
optical  devices  [83,84]  and  cellular  liquid  crystal  systems  [65]  also  show  promise.  In 
effect,  real-time  devices  with  parallel  optical  bistability,  fast  switching  times  (on  the 
order  of  milliseconds  or  less) ,  good  resolution  (a  1000x1000  point  array  is  desirable)  are 
needed.  The  advantages  of  signal  regeneration,  noise  suppression  and  logical  operations 
are  well  known  in  serial  digital  processors;  the  hardware  and  software  implications  of  a 
parallel  optical  logic  architecture  remain  almost  completely  unknown  and  should  be 
investigated  in  the  future. 


6.  Summary  and  conclusions 

This  paper  has  attempted  to  review  briefly  work  in  nonlinear  optical  information 
processing.  The  field  is  broad,  and  in  the  limited  space  available  we  have  concentrated 
on  point  nonlinear  functions  because  they  are  the  best  developed  theoretically  and 
experimentally.  The  main  approaches  to  point  nonlinear  processing  have  been:  halftoning; 
intensity-to-spatial  frequency  conversion;  and  direct  nonlinear  processing  using  tne 
inherent  characteristics  of  image  detection  and  modulation  systems.  Real-time 
implementations  of  all  these  approaches  along  with  many  application  examples  have  been 
discussed.  Other  areas  which  have  not  been  covered  in  detail  will  be  included  in  a 
greatly  expanded  version  of  this  paper  to  be  published  [29].  Additional  topics  to  be 
included  are:  a  classification  of  nonlinear  systems  based  on  the  cascade  of  linear  systems 
with  point  nonlinear  point  functions;  feedback  optical  processors  which  perform  nonlinear 
functions;  details  of  halftone  screen  synthesis  procedures;  analysis  of  the  degrading 
effects  of  non- ideal  halftone  recording  media;  and  design  examples  for  many  specific  types 
of  useful  nonlinearities. 
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Figure  1.  The  halftone  encoding  process. 
A  continuous  input  density  (a)  adds  with 
the  halftone  screen  density  (b)  to 
produce  a  modulated  image  density  (c). 
This  is  recorded  with  a  hardclipping 
film  whose  characteristic  is  shown  in 
(d) .  (e)  is  the  resultant  halftoned 

image. 


Figure  4.  Logarithmic  function  for  a 
piecewise  linear  model  of  a  recording 
medium  with  gamma  ■  3.0.  (a)  Ideal, 
(b)  Degraded,  (c)  Optimized. 
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Figure  2.  Demodulation  of  the  halftonec 
picture  in  a  coherent  optical  system. 
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Figure  3.  Transmittance  vs.  input 
density  for  a  general  non-ideal 
recording 
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Figure  5.  Level  slice  function  for  a 
piecewise  linear  model  of  a  recording 
medium  with  gamma  ■  3.0.  (a)  Ideal, 

(b)  Degraded.  (c)  Optimized. 
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Figure  10.  Input  image  for  optical  A/D 
conversion . 
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Figure  9.  First  three  bit-planes  of 
Gray  code  A/D  conversion  performed  o 
linear  intensity  wedge. 
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Figure  12.  Liquid  crystal  characteristic 
curve.  (a)  Without  the  halftone  screen, 
(b)  With  halftone  screen  designed  to 
give  a  logarithmic  response  over  two 
decades. 


Figure  11.  First  three  bit  planes  of  a 
Gray  code  A/D  conversion.  The  bit 
planes  on  the  left-hand  side  were 
generated  optically.  The  bit  planes  on 
the  right-hand  side  were  produced 
digitally  after  scanning  with  a 
microdensitometer. 
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Figure  13.  Experimental  setup 
real-time  halftone  processing 


Figure  14.  Real-time 
processing  with  a  ha 
LCLV.  (a)  Fourier 
crossed  gratings  imag 
no  halftone  screen, 
are  convolved  with 
Fourier  transform  of 
with  the  halftone  scr 
order,  the  off-axis 
eliminated  indicat 
spectra  are  not  co 
another . 
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Figure  lb.  Real-time  homomorphic 
filtering.  (a)  Input  image  is  a  face 
with  simulated  push-broom  scanner  noise. 
Overall  density  range  is  2.0  D.  (b) 
Homomorphic  filtered  output. 


Figure  16.  r -tensity  to  spatial 
frequency  conversion  for  nonlinear 
processing.  (a)  A  device  is  used  to 
convert  input  intensity  into  a  varying 
spatial  frequency  s.  (b)  A  Fourier  plane 
filter  selectively  attenuates  the 
spatial  frequency  component  s.  (c)  The 
lout  vs*  1  in  characteristic  of  the 
overall  filtering  system  can  be  found 
graphically  by  tracing  through  the  two 
characteristics  of  (a)  and  (b) . 
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Figure  22.  Experimental  arrangement  for 
performing  logical  operations  on 
two-dimensional,  binary  inputs  with  a 
VGM  device.  The  two  binary  input  images 
are  superimposed  on  the  photoconductor. 
The  device  is  read  out  in  transmission. 
Simple  slit  filters  can  be  used  to 
achieve  the  desired  logic  operations. 
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Figure  24.  Implementing  sum  and  carry 
bit  planes  of  a  full  adder  with  one  VGM 
device.  The  inputs  are  bit-planes  from 
images  A  and  B  and  the  carry  bit-plane 
C.  Whenever  two  or  more  of  the  three 
inputs  are  "1",  the  carry  output  should 
be  "1".  The  sum  bit  should  be  "1"  if  an 
odd  number  of  inputs  are  "1". 
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Figure  26.  System  for  parallel  A/D 
conversion . 


INPUT 

B 


INPUT  A 

O 
I 


0  1 
1 


INPUT  LEVELS 


Figure  23.  VGM  logic  results.  Two 
binary  images  were  superimposed  on  the 
photoconductor  to  produce  the  input 
intensities  as  shown  in  the  upper-left 
corner.  Without  any  filter,  the  output 
is  ideally  a  uniform  field  (logical  1). 
The  output  field  with  no  filter  is  shown 
in  the  lower  left  corner  with  the  image 
area  of  interest  indicated  by  the  dotted 
lines.  The  truth  tables  for  the  various 
logic  functions  are  shown  on  the  right 
above  their  corresponding  experimental 
output. 


Figure  25.  Nonlinear  characteristic 
required  for  the  three-bit  Gray  code. 
Solid  curves  are  the  desired 
characteristics  for  the  bit-plane 
outputs.  Dotted  curves  are  the  ideal 
sinusoidal  response  of  a  linear 
birefringent  device.  Parts  (a)  through 
(c)  represent  increasingly  significant 
output  bits. 
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Figure  27.  Experimental  se*-up  for 

real-time,  parallel  A/D  conversion. 


Figure  29.  Direct  A/D  conversion.  The 
eight-level  analog  input  is  shown  at  the 
top.  Below  is  the  binary  coded  output 
in  the  form  of  three  bit  planes  of  the 
Gray  code. 
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Figure  28.  Response  curve  of  the 
liquid-crystal  device  used  for  the 
three-bit  A/D  conversion.  The  solid 
curve  is  the  measured  response.  The 
dotted  curve  represents  the  same 
response  with  a  fixed  attenuation  of  the 
input . 
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Figure  30.  Experimental  optical  feedback 
system  using  a  LCLV. 
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Figure  31.  LCLV 
response . 


feedback 


system 


Figure  32.  Schematic  diagram  of  the 
multiple  light  valve  system  (MLVS)  for 
nonlinear  optical  processing. 
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Figure  34.  Response 
programmed  for 
characteristic. 
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Figure  35.  Level  slice  operation 
performed  with  the  mlvs.  (a)  Input 
image.  (b)  level  slice  output. 
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Discussion  (Alexander  A.  Sawchuk;  Discussion  Leader:  Kua-Kuang  Liu) 

Q.  You've  given  a  very  nice  summary  of  point  nonlinearitites  and  their  role.  Could  you  make  a  comment 
about  non-point  processing,  such  as  perhaps  median  filtering?  Is  there  a  future  for  that? 

A.  The  answer  is  that  if  you  can  do  logic,  then  you  can  do  median  filtering,  so  it  doesn't  reallv  matter 
if  you  are  working  on  a  point  or  a  total  neighborhood  of  points.  If  you  can  make  decisions  (e.g.  is  this 
sample  greater  than  that  sample),  then  you  can  effectively  do  a  median  filter. 

R.  We  can  do  that  with  parallel  processors  by  using  feedback. 

C.  There  is  a  meeting  going  on  now  in  North  Carolina  on  optical  bistability.  It  is  already  possible  to 
make  a  bistable  device  with  spatial  resolution.  Now  it  is  only  4  or  6  elements,  but  the  approach  does  exist. 
The  whole  area  of  nonlinear  optics  is  directed  towards  developing  a  nonlinear  spatially  resolved  device. 

R.  That's  good,  because  if  we  can  get  an  imaging  optical  device  with  a  reasonable  number  of  resolution  ele¬ 
ments,  even  100  x  100,  then  we  can  do  a  lot  of  these  things  and  do  them  adequately. 

C.  If  you  can  do  more  than  just  a  point  with  optics,  then  you  have  an  advantage  over  electronic  chips  ir. 
the  connectivity  area.  They  can  easily  do  one  pixel  at  a  time,  but  if  you  want  to  look  at  several  neighbors, 
you  have  to  have  wires  to  do  that  connection.  Thus  the  neighborhood  in  VLSI  ’ ->s  to  be  rather  small.  That  is 
one  problem  we  might  avoid  in  optics  because  the  interconnections  are  easier. 

C.  I'm  curious  about  the  variable  grating  mode  used  in  the  light  valve.  It  seems  you  mentioned  that  the 
spatial  frequency  bandwidth  extended  from  about  100  lines/mm  to  800  lines/ram.  That's  more  than  you  can 
exploit  in  one  dimension. 

R.  It  does  lead  to  problems  because  your  optics  must  be  quite  good  to  resolve  these  high  orders.  You  have 
to  be  careful  about  the  resolution  number  because  although  the  grating  period  is,  say,  600  lines /rat,  each 
pixel  must  extend  over  several  grating  periods,  so  we  are  really  talking  about  5  or  6  periods  within  each 
pixel. 

C.  One  important  point  about  doing  analog  processing  in  the  variable  grating  domain:  if  you  want  to  get 
on  the  order  of  10  quantization  levels,  you  need  to  have  a  number  of  grating  periods  per  pixel  of  10  or  more. 

C.  The  A/D  converter  scheme  that  we  have  shown  in  this  talk  is  done  with  bi-ref ringent  valves,  it  is  not 
done  with  the  variable  grating  mode.  The  fundamental  limitation  there  in  terms  of  the  number  of  bits  we  can 
obtain  is  one  of  the  periodicity  of  the  valve  Itself.  The  valve  is  really  two  components,  there's  the  bi- 
refrlngent  component  and  a  photoconductive  part.  We  believe  that  most  of  the  nonlinear  effects  are  due  to 
the  photoconductor,  so  we  really  feel  it  is  a  photoconductor  problem. 

C.  I  was  thinking  of  the  variable  grating  mode  and  how  you  are  using  it,  in  terms  of  how  one  might  come  up 
with  a  new  invention.  The  critical  thing  you  have  done  is  perform  a  mapping  from  intensity  to  position  in 
plane,  in  this  case  a  spatial  frequency  plane,  which  you  can  access  with  filters.  That  particular  mapping 
involves  Intensity  to  spatial  frequency  and  then  to  spatial  position.  Maybe  that  suggests  looking  at  c .her 
intermediate  steps  where  you  go,  say,  from  intensity  to  color  and  from  color  to  spatial  position. 

Q.  Explain  what  happens  mathematically  with  the  variable  grating  system. 

A.  Every  resolvable  input  brightness  level  locally  modulates  the  variable  grating.  You  then  get  different 
orders  in  the  spatial  frequency  plane,  and  the  positional  information  of  each  pixel  is  modulated  on  top  of 
its  respective  order.  When  you  inverse  transform,  the  pixel  comes  out  in  its  correct  spatial  orientation  but 
with  a  change  in  gain  which  you  can  control  by  putting  an  attenuating  filter  in  the  spatial  frequency  plane. 
This  is  a  new  kind  of  device  and  there  are  many  new  kinds  of  things  you  can  do  with  it.  There  may  be  many 
applications  to  space-variant  systems  because  this  is  an  intensity  variant  processing  scheme. 

Q.  You  mentioned  that  6  to  8  bits  of  accuracy  is  what  we  seem  to  be  able  to  do  with  analog  systems,  and 
that  seems  to  agree  with  everybody's  experience.  In  the  field  of  analog  electronic  computers,  you  find  much 
higher  accuracies  possible,  down  in  the  1  part  in  10,000  range.  What  are  your  views  on  why  we  seem  to  have 
an  accuracy  floor  that  is  so  different  from  what  is  encountered  in  analog  electronic  processing? 

A.  I  think  one  problem  is  that  in  optics  you  have  a  parallel  array  of  channels,  and  in  an  analog  computer 
you  essentially  have  one  dimension.  Another  thing  is  that  the  inherent  nature  of  electronics  is  much  more 
noise  free  than  coherent  optics,  where  we  have  to  worry  about  phase  and  other  things.  Also,  if  you  look  at 
techniques  other  than  Intensity,  like  polarization,  for  carrying  information,  it  is  rather  difficult  to  meas¬ 
ure  polarization  to  1  part  in  even  20. 

C.  I  have  a  speculation  that  these  a  .ectronic  analog  computers  usually  have  feedback  to  stabilize  the  sys¬ 
tem,  and  none  nf  our  optical  systems  have  feedback. 

Q.  Do  we  really  need  that  kind  of  accuracy  in  our  systems? 
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A.  Yes,  for  people  who  are  noc  so  much  interested  in  looking  at  pictures  at  the  output,  but  rather  discrim¬ 
inating  a  complicated  signal  with  large  dynamic  ranges. 

C.  Electronic  devices  are  also  inherently  much  more  linear  than  most  of  the  things  we  talk  about  in  optics. 
Almost  every  time  you  do  an  image  intensity  to  electronic  signal  transfer,  you  are  talking  about  working  with 
very  nonlinear  devices,  and  there  is  no  single  device  you  can  think  of  that  has  a  very  wide  range  of  linear¬ 
ity  except  a  photomultiplier. 

C.  Also  PIS  junctions  as  detectors  have  large  dynamic  ranges  and  good  linearity,  even  arrays  of  them. 

C.  There's  no  physics  in  talking  about  parallel  versus  single  channels  and  saying  you  ought  to  have  more 

noise  in  parallel  systems. 

S.  Yes,  there  is,  because  of  crosstalk  problems. 

.  But  isn't  chat  a  scattering  problem? 

A.  So.  Uhen  you  have  a  PIM  photodiode,  the  reason  that  it  is  linear  is  chat  Che  device  is  fully  depleted. 

If  you  do  the  thing  in  parallel,  you  have  complete  crosstalk  between  che  channels,  there  is  no  way  to  Isolate 

unless  one  would  array  them.  In  trying  to  array  them,  one  gets  into  a  very  difficult  processor  problem.  So 
I  chink  there  is  some  difference  there  between  parallel  and  single  channel  processors. 

C.  It's  a  very  serious  problem  if  the  accuracy  of  an  optical  system  is  limited  to  6  to  8  bits.  Then  you 
can  forget  about  doing  most  radar  signal  processing,  because  they  want  90  db  of  dynamic  range.  There  are  of 
course  Iocs  of  other  applications  without  this  constraint.  But  I  would  like  to  know  the  basic  physics  behind 
this  limit.  If  there  is  no  physics,  then  there  is  research  to  be  done.  If  there  is  a  physics  limitation, 
Chen  people  don't  need  co  spin  their  wheels  on  this  type  of  application. 

C.  I'd  like  co  mention  thac  with  a  good  liquid  crystal  light  valve  and  an  image  converter  to  increase  gain, 

you  can  use  a  feedback  system  which  would  give  you  the  linearity  that  you  need. 
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Abstract 


Several  candidate  real  time  spatial  light  modulator  technologies  for  coherent  optical 
processing  applications  are  reviewed.  Physical  principles  of  operation  are  describea,  as 
are  current  technological  and  fundamental  physical  limitations  on  device  performance.  a 
number  of  promising  directions  for  current  and  future  research  on  spatial  light  modulators 
are  presented. 


I .  Introduction 

Following  the  advent  of  the  laser,  and  directly  stimulated  by  its  ready  availability, 
tremendous  progress  has  been  achieved  during  the  past  two  decades  in  tne  development  of 
coherent  and  incoherent  optical  processing  techniques.  However,  tne  many  advantages  ox 
two-dimensional  parallel  processing  are  not  fully  exploitable  in  image  and  data  processing 
systems  without  the  availability  of  appropriate  real  time  spatial  lignt  modulators. 
Although  a  wide  range  of  candidate  spatial  light  modulator  technologies  nave  been  proposeo 
and  extensively  researched  and  developed,  no  single  candidate  has  as  of  yet  emergeo  that  at 
once  satisfies  the  system  requirements  of  low  cost,  reliability,  and  ease  of  operation  while 
simultaneously  exhibiting  the  requisite  technical  performance  characteristics  demanoec  by 
increasingly  complex  optical  processing  applications. 

Several  factors  have  primarily  contributed  to  the  present  gap  between  tne  level  of 
sophistication  of  optical  processing  techniques  and  the  development  status  of  spatial  lignt 
modulators  necessary  for  real  time  implementations  of  such  techniques.  First  and  foremost, 
device  research  and  development  is  inherently  expensive  due  to  large  capital  equipment 
requirements,  necessary  parallel  research  and  development  efforts  in  growth,  deposition,  and 
characterization  of  materials,  and  multiple  iterations  of  device  design  on  tne  basis  of 
operational  characterization  and  application-dependent  criteria.  To  date,  the  prospective 
market  for  such  devices  has  not  generally  been  viewed  as  large  enough  to  encourage  tne  type 
of  major  investments  that  stimulated  rapid  progress  in  such  areas  as  information  displays 
and  solid  state  lasers.  An  added  complication  arises  from  the  fact  that  all  of  the  current 
candidate  spatial  light  modulators  are  active  devices,  and  as  sucn  require  extensive 
parametric  characterization  coupled  with  comprehensive  understanding  of  the  fundamental 
device  physics  for  optimum  results  in  diverse  applications.  Major  progress  in  both  of  these 
areas  has  been  a  relatively  recent  development.  Finally,  it  has  become  increasingly 
apparent  that  no  single  spatial  light  modulator  (at  least  of  those  presently  envisioned)  is 
capable  of  satisfying  the  wide  range  of  at  times  conflicting  demands  stemming  from  tne  great 
diversity  of  proposed  real  time  optical  processing  applications. 

In  the  past  few  years,  research  has  been  initiated  in  a  number  of  laboratories  on  the 
physical  principles  of  operation  of  generic  classes  of  spatial  light  modulators,  on  tne 
requisite  materials  technologies,  on  methods  of  device  characterization  and  analysis,  anc  on 
new  types  of  spatial  light  modulators  for  special  applications.  Such  research  has 
demonstrated  encouraging  results,  particularly  in  the  areas  of  increased  physical 
understanding  of  optimum  device  operational  modes  and  design  parameters,  and  of  novel  oevice 
technologies. 

In  view  of  the  numerous  extensive  reviews  of  spatial  light  modulators  that  nave  already 
been  published  (1-7)  the  purpose  of  this  paper  is  to  present  a  survey  of  recent  results  in 
the  research  areas  described  above.  In  particular,  emphasis  will  be  placed  or,  our  present 
understanding  of  some  of  the  fundamental  physical  limitations  inherent  in  several  of  tne 
more  promising  spatial  light  modulator  technologies.  In  succeeding  sections  of  this  paper, 
performance  parameters  of  spatial  light  modulators  are  briefly  described  with  emphasis  on 
several  difficulties  inherent  in  such  performance  evaluation  and  specification.  Current 
progress  in  three  major  types  of  spatial  light  modulators  (electrooptic,  liquid  crystal,  anc. 
photoref ractive)  is  then  described.  Finally,  some  future  directions  for  research  in  several 
of  these  areas  are  suggested. 
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II.  Performance  Evaluation  of  Spatial  Light  modulators 

A  wide  range  of  potential  applications  exists  for  real  time,  recyclable  spatial  light 
modulators  in  systems  implementations  of  coherent  optical  processing  techniques.  These 
applications  include  use  as  the  input  incoherent-to-coherent  image  transducer  in  optical 
correlators  and  convolvers,  programmable  Fourier  plane  filters,  ser ial-to-parallel 
(two-dimensional)  buffer  memories,  page  composers  for  holograpnic  memories,  real  time 
holographic  recording  media,  and  holographic  Fourier  plane  filters.  In  addition,  many 
optical  processing  applications  demand  considerable  image  preprocessing,  including  contrast 
variation,  contrast  enhancement,  contrast  reversal,  edge  enhancement,  image 
addition/subtraction,  thresholding,  level  slicing,  and  minimization  or  elimination  of  the 
zeroth  diffracted  order  in  the  Fourier  plane. 

Performance  evaluation  of  each  of  the  candidate  spatial  light  modulator  technologies 
is  complicated  by  the  innerently  diverse  requirements  demanded  by  such  a  wide  range  of 
applications  and  desirable  features.  A  number  of  performance  parameters  important  in 
coherent  optical  processing  applications  are  presented  in  Table  X.  This  listing 
characterizes  device  parameters  required  for  primarily  'linear*  applications,  in  which  the 
SLM  output  amplitude  is  optimally  a  linear  function  of  the  input  intensity.  Additional 
parameters  should  be  added  for  characterization  of  SLM's  designed  for  "nonlinear* 
applications,  including  ideality  of  the  implemented  nonlinear  function  (e.q.,  logarithmic 
for  homomorphic  filtering,  or  step  for  thresholding),  programmability  of  the  nonlinearity 
(e.g.,  variable  level  slicing),  extended  resolution  requirements  (e.g.,  halftoning)  and  the 
necessity  for  post-modulator  thresholding  (i.e.,  electronic  or  optical). 


TABLE  I:  PERFORMANCE  PARAMETERS  FOR  SPATIAL  LIGHT  MODULATORS: 
"LINEAR"  APPLICATIONS. 


linearity 
sensitivity 
resolution;  MTF 
contrast 

address  mechanism 
write/read  wavelengths 
erase  mechanism 
grey  scale  (dynamic  range) 
storage  capability/time 
phase  or  amplitude  readout 
Fourier  plane  signal-to-noise 


cycle  time 
optical  quality 
optical  uniformity 
phase  dependence 
operational  complexity 
fabrication  complexity 
lifetime 
cost 

special  features 
reciprocity  behavior 

ratio 


The  difficulty  of  side-by-side  comparison  of  SLM's  is  readily  apparent  from  the 
considerable  number  of  characteristics  presented  in  Table  I.  The  suitability  of  an 
individual  SLM  also  depends  critically  on  the  particular  application  for  wnicn  it  is 
envisioned.  Furthermore,  data  describing  several  of  these  performance  parameters  can  be 
highly  misleading  due  to  differences  in  definition  and  measurement  techniques  (1,8).  For 
example,  device  sensitometry  (linearity  and  sensitivity),  resolution  (modulation  transfer 
function) ,  Fourier  plane  signal-to-noise  ration,  uniformity  (global  vs.  local) ,  and 
exposure-dependent  phase  present  particular  complications  in  specification  and 
interpretation.  Sensitometry,  resolution,  and  exposure-dependent  pnase  depend  on  a  wide 
range  of  parameters  (including,  for  example,  wavelength  input,  exposure  magnitude,  exposure 
pulse  duration,  operational  mode  (biasing  conditions),  readout  mode,  magnitude  of  baseline 
subtraction)  since  SLM's  are  truly  active  devices.  Resolution  (MTE)  specifications  also 
depend  3trongly  on  the  measurement  technique  and  analytical  method  employed  (8)  due  to 
physical  differences  in  device  response  to,  for  example,  holographic  fringe  exposure  as 
opposed  to  inconerent  grating  exposure  at  a  given  wavelength.  Measurement  of  Fourier  plane 
signal-to-noise  ratio  and  device  uniformity  are  largely  dependent  on  defect  densities  that 
vary  greatly  from  device  to  device  due  to  lacK  of  appropriate  manufacturing  process  control. 

The  problems  noted  above  with  regard  to  accurate  parametric-  and  application-dependent 
characterization  of  SLm's  are  by  no  means  insurmountable.  Rattier,  tney  point  out  tne 
importance  of  continued  advances  in  the  fundamental  physical  understanding  of  device  design 
and  operation.  As  will  be  illustrated  in  several  cases  below,  such  improved  understanding 
can  indicate  optimum  design  criteria,  new  operational  modes,  and  new  applications  for 
traditional  SLm's,  as  well  as  provide  direction  for  the  development  of  novel  SLM 
technolog  ies . 

In  the  following  tnree  sections,  current  progress  in  each  of  three  categories  of 
spatial  light  modulators  is  highlighted,  witn  empnasis  on  the  physical  principles  of  device 
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operation,  principal  advantages  and  disadvantages  for  potential  applications,  and  wnere 
appropriate  on  current  tecnnolog ical  vs.  fundamental  limitations  of  device  performance. 
The  scope  of  this  paper  is  necessarily  limited,  anc  tne  goals  are  to  describe  recent  result* 
that  demonstrate  the  importance  of  advances  in  device  understanding  on  SwM  operation,  as 
well  as  to  point  out  a  number  of  promising  novel  SLM  technoioy ies .  This  focus  has 
necessitated  some  selectivity  in  the  types  of  devices  treated.  Spatial  liyht  Riooulatois 
based  on  thermoplastic,  deformable  oil  film,  deformable  membrane,  electrooptic  ceramics 
(PL2T) ,  magnetooptic,  photochromic  and  photooicnroic  effects  nave  been  reviewed  previously 
(see  Refs.  1-7).  in  Section  111,  progress  ir,  electrooptic  spatial  lignt  moouiators  is 
described,  including  the  Pockels  Readout  Optical  Modulator  (PROM),  tne  MicroChannel  Spatial 
Light  Modulator  (MSLM) ,  and  the  photo-  and  electron  beam-DKDP  devices.  Section  IV  covers 
recent  advances  in  liquid  crystal  spatial  light  modulators,  including  tne  nybrid  fieio 
effect  liquid  crystal  iight  valve  (LCLV),  the  Si-addressed  LCLV,  and  the  newly  developed 
CCD-addressed  LCLV.  In  addition,  two  novel  liquid  crystal  devices  are  described  for 
nonlinear  processing  applications:  tne  multiple  period  LCLV  for  parallel  A/D  conversion  anc 
the  variable  grating  mode  liquid  crystal  device  for  implementation  of  arbitrary  point 
nonlinearities  and  optical  logic  and  computing  applications.  Pnotoref racti ve  effect  spatial 
light  modulators  for  applications  in  correlation/convolution,  edge  ennancement , 
double-exposure  holographic  testing,  and  phase  conjugate  image  generation  are  described  in 
Section  V. 


III.  Electrooptic  Spatial  Light  Modulators 

Electrooptic  spatial  light  modulators  (ESLM's)  have  been  investigateo  for  numerous 
applications  in  coherent  optical  signal  processing,  including  the  Pockels  Readout  Optical 
Modulator  (PROM)  (9),  the  MicroChannel  Spatial  Light  Modulator  (MSLM)  (10,11),  tne  electron 
beam-DKDP  SLM  (TITUS)  (12,13),  and  tne  photo-DKDP  SLM  (PHOTOTITUS)  (14,15).  Sucn  devices 
record  two-dimensional  image  information  in  the  form  of  a  charge  pattern  wnicn  moaulates  tne 
voltage  across  an  active  (electrooptic)  single  crystal  layer.  Tne  cnarge  pattern  is 
typically  induced  either  by  intensity  modulation  of  light  incident  on  a  pnotoconcuctive 
layer,  or  by  direct  electron  beam  charge  deposition.  More  recently,  image  storage  ir,  ESLm's 
has  been  accomplished  by  exposure  to  x-ray  sources  (13,16)  and  by  nigh  energy  beam  cnarge 
implantation  (13,17).  In  each  case,  the  image-wise  modulated  voltage  is  sensed  using 
polarized  light  by  means  of  the  linear  electrooptic  effect. 

Since  all  four  of  these  electrooptic  spatial  light  modulators  have  a  number  of  similar 
operational  features,  the  description  of  their  essential  characteristics  will  be  simplified 
by  examining  the  physical  operation  of  the  PROM  first  as  an  example,  followed  by  Discussions 
of  each  of  the  other  devices. 

XXI. 1  Pockels  Readout  Optical  Modulator  (PROM) 

A  schematic  diagram  of  a  typical  PROM  structure  is  shown  in  Figure  1.  The  device  is 
comprised  of  a  photoconduct ive ,  electrooptic  crystal  wafer  lBii2£*°20*  sandwiched  between 
two  thin  dielectric  blocking  layers.  The  blocking  layers  are  coated  with  transparent 
electrodes.  The  operation  of  the  PROM  is  shown  schematically  in  figure  2.  A  voltage 
(typically  2  kV)  is  applied  to  the  device,  dividing  between  the  dielectric  and  electrooptic 
layers  in  inverse  proportion  to  the  capacitance  of  each  layer,  a  pulse  of  uniform  uv 
illumination  generates  free  electron-hole  pairs  which  are  subsequently  separated  by  the 
applied  field.  Since  the  mobility-lifetime  product  of  electrons  is  much  larger  than  for 
holes  in  Bii2si°20'  illumination  of  the  negative  electrode  provides  tne  most  efficient  field 
reduction  per  absorbed  photon.  In  this  "erase/prime"  step  (Figure  2),  sufficient  uv 
illumination  is  provided  to  effectively  cancel  the  internal  field  in  the  BSO  layer.  Note 
that  the  dielectric  blocking  layer  thicknesses  must  be  sufficient  to  witnstand  1/2  va__. 
When  the  applied  bias  Va_p  is  now  reversed,  the  applied  field  and  tne  field  due  to  the 
stored  (displaced)  charges  add  rather  than  cancel,  resulting  in  approximately  2V__  dropped 
across  the  BSO  layer.  Illumination  from  the  negative  electrode  side  with  aIfcaye-wise 
modulated  blue  light  causes  electron-hole  pair  generation  and  subsequent  charge  separation 
at  a  rate  proportional  to  the  incident  intensity  at  each  location,  giving  rise  to  a 
reduction  in  voltage  across  the  electrooptic  crystal  in  illuminated  regions.  Since  in  tne 
absence  of  illumination  (subsequent  to  the  writing  process)  the  dielectric  relaxation  time 
UcqP)  of  bismuth  silicon  oxide  is  unusually  large  (of  order  several  thousand  seconds),  the 
electron  distribution  is  trapped  in  the  bulk;  hence,  the  written  charge  distribution  is 
stored.  The  resultant  two-dimensional  voltage  distribution  induces  a  birefringence  (tnrougn 
the  linear  longitudinal  electrooptic  effect)  which  alters  the  polarization  of  linearly 
polarized  readout  light  oriented  to  bisect  the  principal  birefringent  axes,  producing  an 
image-wiae  modulated  amplitude  when  viewed  through  a  crossed  analyzer  (see  figure  3).  'me 
readout  amplitude  transmitted  through  a  PROM  between  ideal  crossed  polarizers  may  De 
expressed  as 
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Figure  X.  Structure  of  a  typical  PROM. 

In  current  PROM' a,  the  electrooptic 
crystal  layer  is  bismuth  silicon  oxide 
(BijoSiOjO/  eao-56cg)  and  the  dielectric 
blocking  layers  are  parylene  c  (ebl*3e«j). 


Figure  2.  Diagram  of  basic  PROM  opera¬ 
tional  sequence,  showing  the  potential 
distribution  within  the  parylene  and 
Bii2sio20  ieyer*  following  each  step  in 
the  erase/prime  and  write/ read  sequence. 
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Figure  3.  Electrooptic  spatial  light 
modulator  readout  configuration  through 
crossed  polarizers. 


Figure  4.  Diagram  of  several  PROM  optical 
processing  operations.  Shown  are  the 
potential  distribution  within  the  parylene 
and  Bii2SiO20  layers  for  the  negative 
write/read,  level  slicing,  contrast 
reversal,  and  contrast  enhancement  functions 
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where  is  the  incident  readout  light  amplitude,  V^,2  is  '’be  half-wave  voltage  of  tue 
electrooptic  crystal,  and  V(x,y)  is  tne  voltage  across  tne  electrooptic  crystal  at  image 
coordinate  (x,y).  It  should  be  noted  that  in  tne  above  expression  it  is  assumec  tnat  tne 
readout  wavelength  and  intensity  are  chosen  sucn  tnat  insigni f leant  pnotoconauctive  charge 
redistribution  occurs,  and  tne  effects  of  natural  optical  activity  in  the  oismutn  silicon 
oxide  crystal  may  be  neglected  (16, IS).  Thus  tne  output  amplituce  is  a  monotonic  function 
of  the  input  intensity  (for  applied  voltages  less  than  the  electrooptic  naif-wave  voltage); 
such  a  transfer  relationship  is  desirable  for  inconerent-to-coneient  conversion  and 
subsequent  coherent  signal  processing  operations. 

The  write/read  mode  described  above  is  presented  again  in  Figure  4,  where  three 
different  levels  of  exposure  are  depicted.  Mote  tnat  in  this  mode  of  operation  a  negative 
of  the  input  image  is  produced  on  readout.  An  image  positive  may  be  created  easily  by 
reversing  the  sense  of  the  applied  voltage,  creating  a  contrast  reversal,  as  shown.  In 
addition,  contour  generation  (level  slicing)  is  achievable  by  varying  tne  external  bias, 
causing  various  internal  field  regions  to  be  cancelled  by  tne  external  applieo  field.  In 
the  illustration  chosen  in  Figure  4,  the  region  labeled  "2"  has  been  brought  to  the  null 
condition  by  suitable  reduction  of  tne  applied  voltage.  Contrast  enhancement  of  highly 
underexposed  images  results  from  external  bias  adjustment  to  disperse  the  exposed  regions 
about  the  zero  field  condition,  as  shown. 

Recent  progress  has  been  acnieved  in  the  analysis  of  tne  fundamental  resolution 
limitations  of  the  PROM  as  well  as  of  the  other  electrooptic  spatial  light  moouiators 
(20-22).  From  the  nature  of  Eq.  (1),  it  can  be  seen  that  the  resolution  of  an  electrooptic 
spatial  light  modulator  depends  directly  on  the  relationship  between  a  periodic  (spatial 
frequency  u>)  variation  in  the  writing  intensity,  and  the  resultant  spatial  modulation  of  tne 
voltage  across  the  electrooptic  crystal.  The  cubic  symmetry  (123)  of  bismutn  silicon  oxiae 
in  conjunction  with  the  orientation  of  the  electrooptic  crystal  slice  (<001>)  assures  tnat 
only  longitudinal  components  of  the  electric  field  contribute  to  the  induced  birefringence 
through  the  electrooptic  effect.  Therefore,  the  modulation  in  output  amplitude  [see 
Eq.  (1)]  depends  only  on  the  voltage  differerce  V(x,y)  between  opposite  sides  of  the 
electrooptic  crystal  at  each  image  point  (x,y).  In  the  absence  of  significant 
two-dimensional  diffusion  effects  in  comparison  with  the  drift-aided  charge  separation  of 
photogenerated  electron-hole  pairs,  V(x,y)  will  be  a  function  of  the  dielectric  constants 
and  thicknesses  of  the  electrooptic  and  blocking  layers,  the  locations  (in  tne  z-direction) 
of  the  trapped  hole  and  electron  distributions  resultirg  from  the  writing  (image  recording) 
process,  and  the  spatial  frequency  of  the  charge  (writing  intensity)  modulation  in  the  (x,y) 
plane. 


From  an  exact  solution  of  the  device  multi-layer  structure  containing  a  single  point 
charge,  the  Fourier  transform  of  the  voltage  distribution  (which  can  be  directly  relates  to 
the  modulation  transfer  function)  was  derived  as  a  function  of  the  charge  location  within 
the  electrooptic  crystal  and  the  device  layer  parameters  (20).  Since  the  modulation 
transfer  function  (MTF)  for  a  given  device  will  be  both  exposure  and  modulation  dependent,  a 
more  fundamental  indication  of  expected  device  performance  is  obtained  by  presentation  anc 
discussion  of  the  un-normalized  (V<ui)]  and  normalized  [V(u»)/V(0)J  potential  difference 
functions. 

At  this  point,  it  should  be  mentioned  that  tne  un-normalized  potential  differences  V(u) 
and  the  normalized  function  V(w)/V(0)  have  a  direct  interpretation  useful  for  bot„ 
comparison  of  distinct  devices  of  different  constitutive  characteristics,  ana  for  comparison 
of  the  implications  of  distinct  charge  distributions  (resulting  from  different  exposure 
parameters)  within  a  given  device.  In  particular,  grapns  of  V(u)  as  a  function  of  a 
parameterized  by  different  device  constitutive  properties  assume  equal  exposure  conditions 
(identical  charge  distributions)  while  graphs  of  V(u)/V(0)  assume  optimum  exposure 
conditions  for  each  compared  device  (i.e.,  sufficient  exposure  for  each  device  sucn  tnat 
V (w )  is  optimized  in  the  limit  of  low  spatial  frequencies.  These  types  of  comparisons  are 
familiar  from  the  case  of  photographic  film  (23)  where  the  typical  resolution/sensitivity 
trade-off  forces  a  similar  comparison  of  film  properties  on  the  basis  of  either  response  to 
equal  exposure,  or  response  to  optimum  exposure  (see  Figure  6). 

This  situation  is  graphically  illustrated  by  reference  to  Figures  6  and  7,  wnicn  depict 
the  spatial  frequency  dependence  of  V(u)  and  V(u)/V(0)  for  PROM  device  parameters  as  snown 
in  Figure  7,  with  the  dielectric  constant  of  the  dielectric  blocking  layer  as  a  parameter. 
The  effect  of  increasing  the  blocking  layer  dielectric  constant  is  seen  to  reduce  tne  device 
sensitivity  (see  Figure  6),  while  increasing  the  high  spatial  frequency  response  for  optimum 
exposure  in  both  cases  (see  Figure  7).  in  Figures  6  and  7,  a  single  point  charge  is  located 
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Figure  5.  Resolution/sensitivity  tradoff 
for  photographic  film.  The  unnormalized 
curve  shows  the  reduction  in  sensitivity 
that  accompanies  increased  resolution 
capability. 


Figure  6.  Effect  of  dielectric  blocking 
layer  dielectric  constant  on  the  spatial 
frequency  response  of  V(u>).  A  symmetric 
PROM  device  is  assumed,  with  geometric  and 
constitutive  parameters  as  shown  in  Figure  1. 
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Figure  7 .  Effect  of  dielectric  blocking  Figure  8.  Effect  of  longitudinal  charge 

layer  dielectric  constant  on  the  spatial  position  witnin  the  electrooptic  crystal 

frequency  response  of  V(w)/V(0).  layer  on  the  spatial  frequency  response  of 

V  ( or )  /V (0) .  Note  the  marked  attenuation 
of  the  high  spatial  frequency  response  as 
the  charges  are  increasingly  displaced 
from  their  respective  interfaces. 
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at  one  of  the  dielectric  blocking  layer/electrooptic  crystal  interfaces. 


The  dependence  of  the  spatial  frequency  response  on  the  dielectric  constants  and 
thicknesses  of  the  dielectric  blocKing  layers  (as  shown  in  Figures  6  and  7,  and  in  Figures  5 
and  6  of  Ref.  (20))  indicates  that  new  PROM  devices  can  be  envisioned  with  modulation 
transfer  functions  constant  to  much  higher  spatial  frequencies  than  are  cnaracteristic  of 
presently  available  devices.  Gains  in  MTF  beiiavior  due  to  choice  of  dielectric  blocning 
layer  properties  will  be  accompanied  by  an  overall  reduction  in  device  sensitivity.  Such 
new  devices,  however,  would  provide  significantly  improved  image  fidelity  and  resolution  in 
applications  where  requirements  on  device  sensitivity  can  be  relaxed  (as  is  tne  case  with 
photographic  film).  In  order  to  improve  PROM  resolution,  nigh  dielectric  constant,  nign 
dielectric  breakdown  strength,  high  resistivity  dielectric  blocking  layers  are  required. 

In  an  effort  to  understand  the  effects  of  exposure- induced  charge  distributions 
throughout  the  bulk  of  the  electrooptic  crystal  layer  on  PROM  resolution,  solutions  for 
cases  involving  multiple  point  charges  were  obtained  by  a  linear  superposition  of  tne 
solutions  for  each  separate  point  charge  (21).  In  particular,  the  effect  of  an 
electron-hole  pair  can  be  modeled  if  the  point  charges  are  assigned  opposite  signs.  Tne 
results  of  such  a  calculation  as  a  function  of  the  charge  separation  are  snown  in  Figure  8. 
In  this  calculation,  the  hole  and  electron  were  assumed  initially  constrained  to  opposite 
interfaces,  and  were  subsequently  displaced  symmetrically  into  tne  bulk  of  the  electrooptic 
crystal  layer.  Three  cases  are  depicted  in  Figure  8,  in  whicn  the  hole  and  electron  were 
first  constrained  to  opposite  dielectric  blocking  layer/electrooptic  crystal  interfaces 
(0,560),  and  were  subsequently  displaced  symmetrically  into  the  electrooptic  crystal  layer 
by  50  um  (50,450)  and  100  urn  (100,400),  respectively.  From  Figure  8,  it  is  observed  that 
charges  displaced  from  the  dielectric  blocking  layer/electrooptic  crystal  interfaces 
strongly  degrade  the  high  spatial  frequency  response.  In  addition,  such  displacement 
reduces  the  sensitivity  at  low  spatial  frequencies  (21). 

An  estimate  of  the  device  spatial  frequency  response  resulting  from  optical  exposure 
may  be  obtained  from  iterative  solutions  of  the  charge  transport  equations  under  simulated 
exposure  conditions  (24,21).  Sample  charge  distribution  results  corresponding  to  exposure 
wavelengths  of  450  nm  and  375  nm  for  device  constitutive  properties  as  described  in  Figure  1 
are  shown  in  Figure  9.  The  absorption  coefficients  (a*  30  cm”1  PA*  450  nm;  a  *  b30  cm~l  P 
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Figure  9.  Longitudinal  charge  distribution 
p(z)  calculated  numerically  using  an 
iterated  electron  drift  model  for  two 
exposure  wavelengths  (and  corresponding 
absorption  coefficients) .  Curves  A  and  B 
result  from  exposure  wavelengths  of  450  nm 
and  375  nm,  respectively.  The  left  and 
lower  scales  correspond  to  curve  A,  while 
the  right  and  upper  scales  correspond  to 
curve  B. 


Figure  10.  Normalized  frequency  responses 
V (u)/V (0)  for  the  calculated  longitudinal 
charge  distributions  of  Figure  9.  The 
normalized  response  of  point  charges  at 
the  two  interfaces  is  included  for  compa¬ 
rison. 
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a  »  375  nm)  are  such  that  Che  375  run  case  is  characterized  by  close  confinement  of  the  hole 
distribution  near  the  input  interface  with  snaliow  electron  penetration  into  the  bulk.  In 
contrast,  the  450  nm  case  is  characterized  by  significant  electron-hole  pair  generation 
throughout  the  electrooptic  crystal  layer,  which  results  in  a  sizeable  accumulation  of 
electrons  at  the  far  interface  (as  shown  in  Figure  9). 

The  spatial  frequency  responses  calculated  from  these  widely  disparate  charge 
distributions  are  shown  in  Figure  10.  The  closely  confined  charge  in  the  375  nm  case 
produces  a  nonmonotonic  spatial  frequency  response  (20-22),  whereas  the  volume  excitation 
present  in  the  450  nm  case  generates  a  monotonic  frequency  response.  In  ooth  cases,  the 
high  spatial  frequency  response  asymptotically  approaches  w"  ,  in  contrast  to  the 
asymptote  applicable  to  cases  where  all  charges  are  confined  to  the  interface  (21). 

The  effect  of  exposure-induced  charge  distribution  throughout  the  bulk  of  the 

electrooptic  crystal  layer  is  seen  to  have  a  marked  effect  on  the  high  spatial  frequency 
response  characteristics  of  the  image  storage  process.  The  optimum  resolution  and 

sensitivity  within  a  given  PROM  device  structure  are  obtained  when  the  nole  distribution  is 
constrained  to  the  interface  nearest  the  negative  electrode,  and  the  entire  electron 
distribution  is  swept  to  the  interface  nearest  the  positive  electrode  during  che  writing 
cycle.  The  actual  resolution  and  sensitivity  obtained  for  a  given  device  are  thus  strongly 
dependent  on  the  absorption  coefficient  of  the  electrooptic  layer  at  tne  writing 
illumination  wavelength,  on  the  external  applied  voltage  and  voltage  division  between  the 
multiple  layers  during  the  writing  cycle,  and  on  the  mobility-lifetime  product  of 

photogenerated  electrons  in  the  electrooptic  crystal.  Such  bulk  charge  distribution  effects 
will  also  strongly  affect  the  resolution  and  sensitivity  for  cases  where  the  image-wise 
modulated  charge  pattern  is  induced  by  high  energy  electron  beam  (13,17)  and  x-ray  (16 

sources.  Specification  of  the  exposure  wavelength  (in  addition  to  exposure  level,  bias 
exposure,  operational  mode,  and  MTF  test  method  (3))  is  thus  seen  to  be  critical  for  proper 
device  evaluation  and  comparison.  Research  on  the  physics  of  the  device  operational  modes 
(prime,  erase,  exposure,  and  “superpr ime"  (9))  utilizing  the  charge  transport  and  resolution 
models  described  above  is  currently  in  progress. 

The  PROM  will  continue  to  be  utilized  in  applications  requiring  either  temporal  storage 
or  time  integration.  Current  PROM's  exhibit  excellent  contrast  and  Fourier  plane 
signal-to-noisa  ratio,  moderate  sensitivity  and  resolution,  and  provide  a  number  of  active 
image  preprocessing  functions.  The  principal  shortcomings  of  the  PROM  relative  to  certain 
applications  are  nonlinear  sensitometry  effects  at  high  exposure  levels,  the  necessity  of 
blue  write  wavelengths  for  optimum  sensitivity  and  resolution,  and  the  lack  of  a  completely 
nondestructive  readout  mode  (which  limits  the  available  readout  gain). 

III. 2  MicroChannel  Spatial  Light  Modulator  (MSLM) 

The  MicroChannel  Spatial  Light  Modulator  (MSLM)  (10,11)  is  under  development  for 

coherent  optical  processing  applications  requiring  high  sensitivity,  sucn  as  stellar  speckle 
interferometry  or  low-visibility  optical  communication.  The  MSLM  is  shown  scnematically  in 
Figure  11,  consisting  primarily  of  an  evacuated  cell  (whicn  may  be  either  sealed  or 
demountable),  a  photocathode,  a  microchannel  array  plate,  a  dielectric  mirror,  and  a  thin 
electrooptic  crystal  layer.  The  microchannel  array  plate  consists  of  an  array  of 
semiconducting  glass-lined  pores  CIO  diameter) ,  and  is  bounded  by  two  semi-transparent 
electrodes.  The  pores  are  oriented  at  an  angle  to  the  plate  normal,  so  that  incident 
electrons  impact  the  pore  walls,  giving  rise  to  electron  multiplication  by  successive 
secondary  electron  emission.  The  microchannel  plate  is  separated  from  the  electroo^tic 
crystal  by  a  gap  (“500-1000  um) .  In  combination  with  the  dielectric  multilayer  mirror,  this 
gap  serves  a  voltage  division  function  similar  to  the  dielectric  blocking  layer  in  the  PROm. 

In  operation,  an  initial  electron  distribution  is  emitted  from  the  photocathode  in. 

response  to  an  incoherent  or  coherent  control  image  (witnin  the  wavelength  region  of 
photosensitivity  of  the  photocathode).  After  electron  multiplication  in  the  appropriately 
biased  microchannel  array  plate,  the  amplified  electron  image  is  proximity  focused  onto  the t 

dielectric  mirror.  Either  positive  or  negative  charge  distributions  can  be  written  on  tx.e* 

mirror  surface,  depending  on  whether  the  ratio  of  secondary  (emitted)  electrodes  to  primary 
(incident)  electrons  is  greater  or  less  than  unity  (see  Figure  12).  The  charge  distribution 
induces  a  spatially  varying  longitudinal  electric  field  field  in  the  electrooptic  crystal 
layer,  which  modulates  the  local  refractive  indices  through  the  Pockels  effect.  As  in  the 
case  of  the  PROM,  either  phase  or  amplitude  modulation  can  be  achieved  on  reflective  readout 
by  appropriate  readout  polarization  and/or  orientation  of  the  electrooptic  crystal.  In 
current  devices  (11),  both  LINbO,  and  LiTaO.  z-cut  plates  have  been  utilized  to  produce  pure 
phase  modulation.  3 

The  dynamic  operation  of  the  MSLM  can  be  understood  with  reference  to  Figure  13,  which 
depicts  lines  of  stable  equilibria  (full  bold  lines)  and  a  line  of  unstable  equilibria 
(broken  bold  line)  in  the  state-space  of  the  device  (gap  energy  eVg  as  a  function  of 
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Figure  11.  The  microchannel  spatial  light  Figure  12.  Secondary  electron  emission 

modulator  (MSLM) :  proximity-focussed  characteristics  of  atypical  insulator, 

configuration.  (After  Warde,  Ref.  10).  (After  Warde,  Ref.  11). 


Figure  13.  State-apace  plot  illustrating 
the  dynamic  operation  of  the  MSLM.  (After 
Warde,  Ref.  11). 


Figure  14.  Schematic  diagram  of  the  photo- 
dkdp  spatial  light  modulator.  (After 
Casasent,  Ref.  14). 
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effective  cathode  potential  eV^) .  The  effective  cathode  potential  is  a  function  of  the 
secondary  emission  characteristics  of  the  die’ectric  rairror/crystal  surface,  the  gap  voltage 
V„,  the  microchannel  plate  voltage  Vmcp,  and  the  shape  of  the  electron  energy  distribution 
emitted  from  the  microchannel  plate.  The  parameter  6  is  the  ratio  of  secondary  electrons 
collected  by  other  parts  of  the  system  to  primary  electrons.  With  no  illumination  incident 
on  the  photocathode,  the  gap  voltage  may  be  altered  by  raising  or  lowering  (see 
Figure  11).  If  the  gap  voltage  is  initially  biased  into  the  region  where  6C<1»  illumination 
of  a  particular  region  of  the  photocathode  will  induce  electron  deposition  on  the  crystal, 
causing  the  local  gap  voltage  to  drop  along  one  of  the  vertical  lines  shown  in  Figure  13. 
Saturation  in  this  region  will  '.cur  when  the  total  local  exposure  exceeds  the  level 
required  to  drive  the  gap  ltage  onto  the  stable  equilibrium  curve.  The  image  can  be 
erased  by  subsequently  lowering  the  bias  into  the  region  5C>1  and  uniformly  or  selectively 
illuminating  the  photocathode,  such  that  net  electrons  are  emitted  from  the  surface,  raising 
the  local  gap  voltage  along  one  of  the  dashed  lines  shown.  The  lower  dashed  bold  line 
labeled  Ecopi  represents  unstable  equilibria,  since  lowering  of  the  gap  voltage  below  this 
line  causes  entry  to  a  second  6C<1  region,  such  that  illumination  drives  the  gap  voltage 
toward  the  line  £  »  0  along  which  the  incident  primary  electron  energy  at  the  crystal 
surface  is  zero.  Hehce  once  a  local  region  of  the  crystal  surface  resides  on  this  line,  the 
local  potential  cannot  be  further  altered  without  changing  the  bias  level  Vfa. 

Charge  distributions  have  been  successfully  stored  directly  on  a  500  ym  thick  LiTaO^ 
crystal  (without  a  dielectric  mirror)  for  periods  as  long  as  two  weeks  (11).  Although  the 
surface  and  bulk  resistivities  of  LiTa03  are  such  as  to  result  in  large  dielectric 
relaxation  time  constants,  it  is  likely  that  deep  surface  trap  states  with  extraordinarily 
long  relaxation  times  must  be  involved  in  the  electron-induced  charge  storage  mechanism. 
Research  on  the  nature  of  such  trap  levels  by  spectroscopically  selective  photoemission  is 
currently  in  progress  (25).  The  existence  of  image  storage  capability  can  be  used  in 
concert  with  programmable  variation  of  the  bias  voltage  Vb  to  allow  implementation  of 
several  useful  image  preprocessing  functions.  Image  addition  and  subtraction  can  be 
performed  by  temporal  integration  and  sequential  selective  write/erasure,  respectively. 
Contrast  enhancement  and  reversal  can  be  implemented  by  bias  adjustment  following  exposure, 
as  described  earlier  in  the  case  of  the  PROM.  Utilization  of  the  erasure  saturation 
characteristic  described  above  provides  a  form  of  variable  level  thresholding.  In  addition, 
edge  enhancement  is  possible  due  to  variation  of  the  secondary  electron  emission 
characteristics  in  the  presence  of  fringing  fields  in  a  region  of  exposure  discontinuity. 

One  of  the  most  promising  features  of  the  MSLM  configuration  is  its  inherent 
flexibility  in  both  choice  of  electrooptic  crystal  and  choice  of  photocathode  material 
(which  together  determine  the  readout  and  writing  wavelength  response  regions  for  the 
device,  respectively).  Since  the  microchannel  array  plate  is  inherently  responsive  from 
x-ray  to  near-uv  wavelengths,  no  photocathode  is  required  for  operation  in  this  regime.  The 
device  exhibits  extremely  high  sensitivity,  and  the  physical  separation  of  the  write  and 
read  functions  allows  further  inherent  throughput  gain  in  image  amplifier  applications.  The 
combination  of  long  term  storage  with  (at  present)  near-TV  frame  rates  allows  great 
flexibility  in  system  design.  Current  MSLM' s  exhibit  resolutions  ("3  lp/mm)  limited  by  the 
thickness  of  the  electrooptic  crystal,  the  relatively  thick  dielectric  blocking  layer  (gap), 
and  the  low  dielectric  constant  of  the  gap.  Although  the  implementation  of  the  active  image 
preprocessing  functions  described  above  involves  rapid  programmability  of  relatively  hign 
voltages,  the  almost  purely  capacitive  loading  presented  by  the  MSLM  should  minimize  such 
difficulties. 

III. 3  Photo-DKDP  Spatial  Light  Modulator 

The  photo-DKDP  Spatial  Light  Modulator  (also  called  "PHOTOTIT'JS*  (15))  has  been 
developed  and  is  currently  manufactured  by  Laboratoires  d' Electronique  et  de  Physique 
Appliquee  in  France,  and  has  only  recently  become  available  for  experimentation  in  the 
United  States  (26).  A  schematic  diagram  of  the  photo-DKDP  device  is  shown  in  Figure  14.  A 
wedged  electrooptic  crystal  layer  of  deuterated  potassium  dihydrogen  phosphate  (DKDP )  is 
sandwiched  between  a  dielectric  mirror  and  a  transparent  electrode  on  a  CaF  substrate.  A 
photoconductive  layer  of  amorphous  selenium  is  deposited  on  the  dielectric  mirror,  and  is 
overcoated  with  a  second  transparent  electrode.  This  assembly  is  incorporated  in  an 
evacuated  two-stage  Peltier  cooler  to  allow  operation  near  the  ferroelectric  Curie  point  of 
DKDP  C-50°C) ,  which  enhances  the  resolution  and  storage  time  of  the  device  while 
significantly  reducing  the  half-wave  voltage  of  DKDP  to  approximately  300V.  This  reduction 
in  operating  voltage  is  critical  in  order  to  allow  the  incorporation  of  the  Se 
photoconductor,  which  effectively  separates  the  read  and  write  functions. 

Operation  of  the  photo-DKDP  SLM  is  similar  in  most  respects  to  the  PROM  operational 
modes  described  above,  as  is  depicted  schematically  in  Figure  15.  In  Figure  15(a),  initial 
application  of  a  positive  voltage  Vq  to  the  Se  electrode  produces  a  voltage  division  among 
the  various  layers.  Exposure  to  appropriate  wavelength  write  illumination  (typically 
440-520  nm)  induces  hole  transport  across  the  Se  layer,  reducing  the  voltage  across  the 


photoconductor  and  increasing  the  voltage  across  the  electrooptic  DKDP  crystal 
(Figure  15(b)).  In  Figure  15(c),  the  electrodes  have  been  short-circuited  to  produce  a 
positive  readout  image.  The  small  residual  voltage  V,  in  the  dark  (unilluminated)  region 
arises  from  the  finite  dark  conductivity  of  the  photoconductive  layer  during  the  writing 
cycle.  Erasure  is  accomplished  by  subsequent  uniform  illumination  of  the  photoconductor  to 
induce  electron  transport  to  the  mirror  interface,  thereby  reducing  the  stored  electrostatic 
field  to  zero.  It  should  be  noted  that  exposure  wavelengths  on  the  long  wavelength  side  of 
the  selenium  photoconductivity  response  will  initiate  bulk  electron-hole  pair  generation 
with  resultant  ambipolar  diffusion.  Since  the  mobility-lifetime  product  for  electrons  is 
significantly  smaller  than  that  for  holes,  sensitometry  curves  resulting  from  primarily 
electron  transport  differ  from  those  characterized  by  primarily  hole  transport.  These 
differences  are  especially  important  for  image  subtraction  applications  (14). 

The  photo-DKDP  spatial  light  modulator  has  been  utilized  in  a  wide  range  of  coherent 
optical  data  processing  applications,  and  has  demonstrated  processing  accuracies  comparable 
to  those  achievable  with  photographic  film  inputs  (26).  The  device  as  presently  configured 
has  moderate  sensitivity,  storage  capability,  and  the  availability  of  image  subtraction  in 
addition  to  other  image  preprocessing  functions.  The  resolution  is  enhanced  relative  to 
that  exhibited  by  current  PROM's  due  to  the  increase  in  dielectric  anisotropy  resulting  from 
Curie  point  operation.  On  the  other  hand,  this  very  feature  limits  the  contrast  available 
in  non-coil imated  readout  configurations  due  to  large  natural  birefringence.  The  necessity 
of  cooling  to  achieve  proper  device  performance  can  led  to  nonuniformities  in  device 
characteristics,  since  small  temperature  differences  yield  large  changes  in  the  magnitude 
and  ratio  of  the  dielectric  constants.  The  hygroscopic  nature  of  DKDP  necessitates  the  use 
of  an  evacuated  cell;  however,  even  with  this  constraint  the  reported  optical  quality  of 
current  devices  is  excellent  (14). 

III. 4  Electron-Beam  DKDP  Spatial  Light  Modulator 

The  electron-beam  DKDP  SLM  has  been  under  development  for  many  years  for  coherent 
optical  processing  applications,  and  has  been  implemented  during  the  past  ten  years  in  two 
similar  versions  (12,13).  The  primary  difference  between  this  electrooptic  spatial  light 
modulator  and  the. three  previously  described  is  the  mode  of  address.  As  shown  in  Figure  16, 


Figure  15.  Distribution  of  voltage  as  a 
function  of  distance  in  the  photo-DKDP 
SIM  at  different  operational  steps  for 
illuminated  (BR)  and  unilluminated  (DK) 
regions.  (After  Casasent,  Ref.  14). 


Figure  16.  Electron-beam-addressed  Pockels 
effect  imaging  device  using  a  DKDP  (KD2PO4) 
crystal  plate  operated  in  the  reflection 
mode .  A  constant  current  electron  beam  is 
used  and  the  video  signal  is  applied  between 
the  transparent  conductive  layer  and  the 
main  grid  placed  at  about  40  um  from  the 
target.  (After  Marie,  Ref.  13). 
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charge  is  deposited  on  a  dielectric  mirror/electrooptic  crystal  layer  by  an  axial  (13)  or 
off-axis (12)  electron  gun  driven  in  a  raster  pattern  and  grid-modulated  by  a  serial  (usually 
video)  input.  The  physics  of  operation  of  this  device  thus  combines  several  features  of  the 
MSLM  and  the  photo-DKDP  SLM.  The  design,  operation,  and  applications  of  this  SLM  have  been 
extensively  documented  (12,13)  and  are  not  treated  herein.  In  addition  to  a  wide  range  of 
applications  in  optical  data  processing,  the  electron-beam  DKDP  spatial  light  modulator  has 
been  successfully  utilized  for  large-screen  multi-color  television  projection  display  (13). 

IV.  Liquid  Crystal  Spatial  Light  Modulators 

A  number  of  spatial  light  modulator  technologies  are  based  on  the  utilization  of  liquid 
crystals.  The  attractiveness  of  liquid  crystal  layers  for  this  application  arises  primarily 
from  several  unusual  characteristics  of  nematic  liquid  crystals,  including  large  dielectric 
anisotropies  (resulting  in  low  operating  voltages),  large  birefringences  (resulting  in 
sizeable  polarization  effects  even  in  the  thin  cells  necessary  for  rapid  response  times)  , 
and  a  wide  variety  of  possible  alignment  configurations.  In  this  section,  several  liquid 
crystal  spatial  light  modulators  are  discussed,  including  some  potentially  exciting 
modifications  of  the  Hughes  liquid  crystal  light  valve,  as  well  as  two  novel  liquid  crystal 
devices  for  nonlinear  coherent  optical  processing  applications. 

IV. 1  Hybrid  Field  Effect  Liquid  Crystal  Light  Valve 

By  far  the  most  advanced  spatial  light  modulator  employing  a  liquid  crystal  layer  as 
the  active  electrooptic  element  is  the  hybrid  field  effect  liquid  crystal  light  valve  (LCLV) 
(27,28).  The  typical  device  configuration  of  the  LCLV  is  presented  in  Figure  17.  A 
transparent  electrode  and  a  chemically  inert  insulating  layer  (SiO )  are  deposited  on  an 
optically  flat  glass  substrate.  The  insulating  Si02  layer  prevents  dc2current  flow  through 
the  device  while  simultaneously  functioning  as  a  preferred  direction  alignment  layer  for  the 
liquid  crystal  and  as  an  ionic  blocking  layer  to  prevent  cell  poisoning  effects.  A  biphenyl 
nematic  liquid  crystal  layer  is  confined  laterally  by  a  deposited  thin  film' spacer,  and 
longitudinally  by  a  second  Si02  alignment  layer.  The  liquid  crystal  layer  is 
photoconductively-addressed  by  a^  thin  film  of  cadmium  sulfide  deposited  on  a  transparent 
electrode-coated  optically  flat  glass  substrate.  Separation  of  the  read  and  write  functions 
is  accomplished  by  incorporation  of  a  dielectric  mirror  and  cadmium  telluride  light  blocking 
layer  between  the  liquid  crystal  layer  and  the  CdS  photoconductor,  as  shown. 

In-  order  to  optimize  the  electrooptic  properties  of  the  liquid  crystal  layer  for 
coherent  optical  processing  applications,  a  hybrid  field  effect  operational  configuration  is 
employed  (27).  In  this  configuration,  the  uniaxial  liquid  crystal  molecules  are 
preferentially  aligned  (by  means  of  appropriate  surface  treatment  of  the  Si02  alignment 
layers)  with  their  long  axes  parallel  to  the  electrode  surfaces  (homogeneous  alignment).  In 
addition,  the  alignment  directions  on  the  two  opposed  surfaces  are  oriented  to  form  an 
included  angle  of  45°.  This  45°  twist  imparts  a  continuous  rotation  of  the  liquid  crystal 
molecules  from  one  surface  to  the  other,  as  shown  schematically  in  Figure  18.  Since  the 
nematic  liquid  crystal  employed  in  this  device  exhibits  large  birefringence  (difference  in 
refractive  indices  for  light  polarized  parallel  and  perpendicular  to  the  molecular  long 
axis)  ,  the  resultant  twisted  layer  can  be  modeled  as  a  succession  of  thin  birefringent 
layers,  each  oriented  at  a  slight  angle  with  respect  to  the  immediately  preceding  and 
following  layers.  Such  an  optical  configuration  has  been  shown  to  be  equivalent  under 
certain  conditions  to  a  purely  optically  active  layer  (29),  so  that  the  polarization  of 
light  traversing  the  layer  undergoes  a  pure  rotation  of  45°. 

The  operation  of  the  hybrid  field  effect  liquid  crystal  layer  can  be  explained  with 
reference  to  Figure  19.  In  the  "off"  state  with  no  voltage  applied  across  the  liquid 
crystal  layer,  input  light  polarized  parallel  to  the  preferential  alignment  direction  of  the 
entrance  electrode  experiences  a  positive  45°  polarization  rotation  on  traversing  the  layer, 
and  a  negative  45°  rotation  following  reflection  from  the  dielectric  mirror  and  a  second 
pass  through  the  cell.  Hence  the  emergent  polarization  is  parallel  to  the  incident 
polarization,  and  can  be  extinguished  with  a  crossed  analyzer  to  provide  a  dark  off  state. 
When  voltage  is  applied  across  the  liquid  crystal  layer,  the  resulting  longitudinal  electric 
field  tends  to  align  the  liquid  crystal  molecules  with  the  field  direction  (due  to  tne 
positive  dielectric  anisotropy  of  the  molecules).  This  "tilt"  toward  perpendicular 
alignment  from  parallel  alignment  varies  continuously  between  the  two  surfaces,  and  is 
largest  in  the  center  of  the  layer  where  the  surface  alignment  forces  are  weakest.  Due  to 
the  physical  nature  of  the  intermolecular  forces,  as  the  tilt  angle  increases  in  a  given 
layer,  the  transmittance  of  the  twist  angle  is  weakened.  Hence  as  the  voltage  is  increased, 
molecules  in  the  layer  center  approach  a  perpendicular  orientation,  allowing  molecules  near 
each  surface  to  relax  toward  an  untwisted  state  with  orientation  parallel  to  the  induced 
surface  orientation.  The  polarization  of  incident  light  will  thus  be  relatively  unaltered 
by  the  front  half  of  the  cell  on  the  first  pass,  but  will  encounter  a  birefringent  layer 
oriented  at  45°  in  the  rear  half  of  the  cell,  causing  the  polarization  of  light  striking  the 
dielectric  mirror  to  be  elliptical.  Since  birefringence  adds  on  reflection  (rather  than 
cancels  as  in  the  case  of  optical  activity),  the  emergent  polarization  from  the  cell  will  in 
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general  be  elliptical,  such  that  the  appropriate  component  will  be  passed  by  the  crossed 
analyzer.  A  detailed  analysis  of  the  cell  transmission  as  a  function  of  voltage  has 
recently  been  performed  (30-32). 

In  order  to  function  as  an  optical-to-optical  converter,  the  LCLV  requires  a  mechanism 
for  spatially-dependent  variation  of  the  liquid  crystal  layer  voltage  in  response  to  an 
input  image  intensity  distribution.  This  function  is  performed  by  the  CdS/CdTe 
hetero junction  in  series  with  the  capacitance  of  the  multilayer  dielectric  mirror.  Analysis 
of  the  operation  of  this  structure  (33,34)  shows  that  photocapacitive  as  well  as 
photoconductive  processes  must  be  considered  to  fully  explain  the  observed  LCLV  sensitometry 
behavior.  The  LCLV  requires  low  operating  voltages  (5-10  V  rms)  at  intermediate  frequencies 
(1-10  kHz)  . 

The  principal  advantages  of  the  hybrid  field  effect  liquid  crystal  light  valve  for 
coherent  optical  processing  applications  are  good  sensitivity  and  resolution 
characteristics,  full  separation  of  the  write/read  functions  (which  allows  for  the 
possibility  of  single  wavelength  optical  feedback,  for  example),  simplicity  of  operation, 
and  low  power  requirements.  The  sensitometry  characteristics  of  the  LCLV  depend  rather 
strongly  on  the  magnitude  and  frequency  of  the  applied  voltage  (35,36);  this  feature  can  be 
used  to  advantage  in  some  applications,  but  also  contributes  to  device  nonuniformity  effects 

(36) .  Device  uniformity  in  both  the  off  and  on  states  has  been  shown  to  be  a  quite 
sensitive  function  of  liquid  crystal  layer  thickness  (30-32),  which  is  particularly 
difficult  to  control  in  such  a  multilayer  structure.  Device  reproducibility  (both  within  a 
given  device  and  from  device  to  device)  is  dependent  primarily  on  the  deposition 
characteristics  of  the  cadmium  sulfide  and  cadmium  telluride  layers,  since  the  optical  and 
electronic  properties  of  II-VI  compounds  are  strong  functions  of  deposition  conditions.  The 
device  response  time  varies  as  a  function  of  input  intensity  (primarily  due  to  the 
characteristics  of  the  CdS  photoconductor) ,  which  when  coupled  with  the  lack  of  storage 
capability  leads  to  temporal  variations  of  the  diffracted  orders  in  the  Fourier  plane  during 
operation,  and  in  some  casts  to  image  ghosting  with  slow  decay  time  constar.es  in  brightly 
exposed  regions  of  the  images.  A  number  of  these  difficulties  are  due  primarily  to  the 
utilization  of  CdS  as  the  photoconductor,  and  should  be  eliminated  with  the  advent  of  the 
Si-LCLV  described  below.  Finally,  it  is  important  to  note  that  the  hybrid  field  effect 
structure  gives  rise  to  an  input-intensity-dependent  phase  shift  of  the  output  wavefront 
that  is  a  further  function  of  the  relative  orientation  of  the  LCLV,  polarizer,  and  analyzer 

(37)  . 

IV.  2  Silicon  Liquid  Crystal  Light  Valve 

Recently,  a  major  potential  technological  advance  in  liquid  crystal  light  valve 
technology  has  been  reported  (38),  resulting  from  incorporation  of  a  silicon  photoconductor 
in  a  hybrid  field  effect  device.  The  structure  of  this  novel  light  valve  is  shown  in 
Figure  21.  The  active  liquid  crystal  layer  is  the  same  as  that  described  previously  for  the 
CdS-addressed  LCLV.  The  CdTe  layer  has  been  replaced  with  a  cermet  light  blocking  layer, 
composed  of  a  multilayer  structure  of  metallic  (tin)  islands  dispersed  in  insulating  (SiOx) 
layers.  A  silicon  dioxide  gate  insulator  is  coupled  to  a  very  high  resistivity  ir-silicon 
wafer  to  form  an  MOS  structure.  A  thin  degenerately  doped  p  layer  forms  the  rear  device 
electrode,  and  is  overcoated  with  a  thermally  grown  protective  oxide  coating.  A  square 
p-doped  grid  just  beneath  the  SiC>2  gate  insulator  serves  to  enhance  the  device  resolution 
(as  described  below) ,  and  p  isolation  channel  stops  surround  the  periphery  of  the  wafer  to 
minimize  minority  carrier  injection  into  the  active  region. 

When  the  Sl/SlO?  Interface  is  biased  into  accumulation,  recombination  at  the  interface 
erases  any  residual  image  and  readies  the  device  for  the  active  mode.  The  Si/SlO,  interface 
Is  then  biased  into  depletion  (depleting  not  only  the  p-grid  but  also  the  entire^  ir-silicon 
layer),  and  the  ir-silicon  side  is  illuminated  with  the  input  image.  Illumination  produces 
local  electron-hole  pair  generation  near  the  back  contact,  with  electrons  subsequently  swept 
to  the  Sl/SiOo  interface  by  the  field  across  the  ir-silicon  layer.  Calculations  show  there 
to  be  only  negligible  spreading  of  the  swept-electron  distribution  during  traversal  across 
the  wafer  (39).  In  addition,  the  depleted  p-grid  is  more  negative  than  the  surrounding 
i-regions,  which  acts  to  focus  the  incoming  electrons  into  the  it-buckets  near  the  Si/Si02 
interface.  The  p-grid  also  prevents  significant  charge  spreading  during  the  readout  cycle. 
Due  to  the  sequential  accumulation/depletion  cycle,  the  mods  of  operation  is  fully  ac,  which 
significantly  extends  the  lifetime  of  the  liquid  crystal  layer.  Once  the  image-induced 
charge  pattern  has  been  established  at  the  Si/Si02  interface,  the  electric  field  across  the 
liquid  crystal  layer  will  be  modulated  such  that  the  device  may  be  read  out  in  reflection 
just  as  described  above  for  the  CdS/CdTe  LCLV. 

Current  performance  parameters  of  the  Si/LCLV  are  quite  encouraging,  with  limiting 
resolution  of  25  lp/mm  at  present  limited  by  a  20  urn  period  grid,  20  uW/cm2  sensitivity,  and 
a  contrast  ratio  of  30:1  (39).  The  device  has  been  successfully  operated  at  TV  frame  rates. 
With  the  Incorporation  of  a  grid  with  6  um  period,  the  limiting  resolution  should  be 
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extendable  to  150  lp/mm.  The  liquid  crystal  layer  is  expected  to  accommodate  such  high 
spatial  frequencies!  since  the  presence  of  grid  lines  3  um  wide  has  been  observed  in  several 
test  structures  (39).  The  silicon  photosensitivity  spectrum  extends  from  the  near  uv  (400 
nm)  into  the  near  ir  (1.1  um)  with  high  quantum  efficiency.  Hence  such  Si-LCLV’s  should 
find  numerous  applications  in  optical  data  processing,  including  real-life  scene  input 
situations. 

IV. 3  CCD-Addressed  Liquid  C rystal  Light  Valve 

Much  of  the  new  technology  evident  in  the  Si-LCLV  is  being  utilized  to  mate  a  high 
bandwidth  serial/parallel  CCD  register  to  a  modified  Si-LCLV  for  optical  processing 
applications  requiring  a  serial  input  format  (40).  As  illustrated  in  Figure  22,  the 
CCD-LCLV  is  similar  in  configuration  to  the  Si-LCLV  described  above.  The  difference  between 
the  two  consists  primarily  in  the  placement  on  the  uppermost  Ti-silicon  surface  of  a  surface 
channel  CCD  array.  Proper  sequencing  of  the  clock  lines  propagates  electron  packets 
under  each  gate.  Subsequent  positive  bias  of  the  liquid  crystal  electrode  drives  the 
electron  packets  to  the  Si/Si02  interface,  where  they  are  focused  and  prevented  from  lateral 
diffusion  by  the  implanted  p-grid.  A  functional  schematic  diagram  of  the  CCD  array  is  shown 
in  Figure  23.  The  input  is  serially  transferred  by  the  series  clock  into  the  CCD  buried 
channel  series  register  until  an  entire  line  of  data  is  recorded.  The  line  of  data  is  then 
transferred  in  parallel  to  the  adjacent  CCD  surface  channel  parallel  structure  as  shown. 
When  all  CCD  registers  are  full,  representing  a  complete  frame  of  input  information,  the 
bias  voltage  is  changed  to  drive  the  entire  stored  electron  packet  array  to  the  Si/Si02 
interface.  At  this  point,  the  two-dimensional  image  can  be  read  out  in  reflection  by 
polarized  illumination  from  the  liquid  crystal  side  of  the  device,  as  shown.  The  buried 
channel  serial  array  is  necessitated  by  the  100  MHz  design  clock  frequency,  while  Che  slower 
(100  kHZ)  parallel  array  requires  surface  channel  technology  to  allow  for  subsequent  charge 
transfer  to  the  Si/SiO  interface. 

Current  CCD-LCLV  devices  are  64x64  arrays  of  elements  on  1.3  mil  centers  (total  active 
area  83  mils  square)  (39).  A  256x256  element  array  is  presently  under  development,  with  an 
eventual  goal  of  a  1000x1000  element  array  operating  at  100  kHz  per  line.  Such  a  device 
would  operate  at  an  overall  frame  rate  approaching  100  HZ.  Several  difficult  technical 
problems  currently  under  investigation  include  the  quality  of  image  transfer  from  the  CCD  to 
the  LC  layer,  development  of  the  novel  buried  channel  serial/surface  channel  parallel  CCD 
approach,  uniformity  of  processing  of  the  very  high  resistivity  u-silicon  wafer,  and  the 
processing  delicacy  required  for  the  5  mil  thinned  wafers.  Achievement  of  these  design 
goals  will  represent  a  long-awaited  major  breakthrough  in  serial  input/parallel  output 
spatial  light  modulator  technology. 

IV. 4  Multiple  Period  Liquid  Crystal  Light  Valve 


A  technique  for  optically  performing  parallel  analog-to-dig ital  conversion  on 
incoherent  two-dimensional  inputs  at  real-time  rates  utilizing  a  multiple  period  liquid 
crystal  light  valve  has  been  recently  described  (41).  This  MP  LCLV  is  similar  in 
construction  to  the  hybrid  field  effect  LCLV  with  the  notable  exception  that  the  liquid 
crystal  layer  was  homeotropically  aligned  (long  molecular  axes  perpendicular  to  tne 
electrode  in  the  "off*  state).  The  liquid  crystal  chosen  has  negative  dielectric 
anisotropy,  so  that  application  of  a  voltage  across  the  layer  tends  to  rotate  the  molecules 
parallel  to  the  electrodes.  The  magnitude  of  the  rotation  is  a  function  of  the  applied 
voltage,  so  that  readout  light  polarized  at  45°  with  respect  to  the  projection  of  the  long 
molecular  axis  on  the  electrode  surface  (in  the  partially  rotated  state)  will  experience 
pure  birefringence  on  traversal  of  the  cell.  For  liquid  crystals  with  large  optical 
anisotropies  (and  for  thick  enough  cells) ,  the  total  phase  retardation  can  be  many  multiples 
of  2it .  Since  the  local  voltage  across  the  liquid  crystal  layer  can  be 
photoconductively-addres3ed,  the  overall  relationship  between  the  intensity  transmittance  of 
the  device  and  the  incident  intensity  at  any  point  is  given  ideally  by  the  sinusoidal  (sin2) 
curve  shown  by  a  dashed  line  in  Figure  24.  In  Figure  24(a),  optical  or  electronic 
thresholding  of  the  device  transmittance  at  one  half  produces  the  least  significant  bit  of 
the  reflected  or  Gray  code.  Rescaling  the  input  intensity  by  a  factor  of  one  half  produces 
the  device  transmittance  curve  shown  in  Figure  24(b).  Thresholding  of  this  curve  at  one 
half  produces  the  next  most  significant  bit,  and  so  on.  Sequential  rescaling  as  shown  in 
Figure  24(a-c)  produces  the  3  least  significant  Gray-code  bit  planes  in  sequence.  Parallel 
rescaling  is  also  possible  utilizing  3  periodically  repeated  attenuating  strips  on  the 
device  surface  of  attenuation  factors  1,  1/2,  and  1/4,  respectively  (41). 

Due  to  the  nonlinear  sensitometry  effects  associated  with  the  cadmium  sulfide 
photoconductor  described  in  Section  IV. 1,  the  actual  device  response  curve  departs 
significantly  from  the  ideal  behavior  of  Figure  24.  The  response  curve  of  the  actual  device 
utilized  for  the  A/D  conversion  experiments  is  shown  in  Figure  25.  The  aperiodic  nature  of 
the  device  response  curve  necessitated  nonuniform  quantization  level  assignments,  as  shown 
in  the  figure.  Nevertheless,  real  time  parallel  three-bit  A/D  conversion  was  performed 
successfully  with  this  device  (41),  with  an  estimated  potential  A/D  conversion  rate  of 
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1.2x108  points  per  second  for  currently  available  device  parameters.  Development  of  a  LCLV 
with  a  more  nearly  periodic  response  function  would  significantly  advance  the  potential  of 
this  technique,  but  requires  linearization  of  both  the  photoconductor  response  and  tne 
relationship  between  applied  voltage  and  effective  birefringence. 

IV. 5  Variable  Grating  Mode  Liquid  Crystal  Device 

Variable  grating  mode  (VGM)  liquid  crystal  devices  offer  a  new  approach  to  the  problem 
of  optical  transducers  (42-44)  for  nonlinear  optical  processing  and  optical  logic  and 
computing  applications.  The  basic  function  of  the  VGM  device  is  to  perform  an 
intensity-to-spatial  frequency  conversion  over  a  two-dimensional  image  field.  In  this 
process,  the  intensity  variations  of  an  input  image  are  converted  to  local  spatial  frequency 
variations  in  a  phase  grating  structure  witnin  the  liquid  crystal  layer.  Due  to  this 
intensity-to-spatial  frequency  conversion,  a  standard  spatial  filtering  system  can  be  used 
to  manipulate  the  input  intensities. 


The  principal  element  of  the  variable  grating  mode  device  is  a  thin  layer  of  liquid 
crystal  that  is  observed  to  form  periodic  stripe  domains  in  the  presence  of  an  appliec 
voltage.  The  formation  of  the  domains  results  in  a  phase  grating  characterized  by  a  spatial 
frequency  that  depends  on  the  magnitude  of  the  voltage  across  the  liquid  crystal  layer.  The 
grating  period  can  be  optically  controlled  by  placing  a  two-dimensional  photoconduct ive 
layer  in  series  with  the  layer  of  liquid  crystal.  The  structure  of  the  photoactivated 
device  is  shown  schematically  in  Figure  26.  The  sputter-deposited  ZnS  photoconductor  and 
the  liquid  crystal  layer  are  sandwiched  between  indium  tin  oxide  transparent  electrodes 
deposited  on  optically  flat  glass  substrates.  To  operate  this  device,  a  dc  voltage  is 
impressed  across  the  electrodes.  The  thin  film  structure  is  designed  to  accept  most  of  the 
drive  voltage  when  the  photoconductor  is  not  illuminated,  such  that  the  fraction  of  the 
voltage  that  drops  across  the  liquid  crystal  layer  is  below  the  activation  threshold  of  the 
VGM  effect.  Illumination  incident  on  a  given  area  of  the  photoconductor  reduces  its 
impedance,  thereby  increasing  the  voltage  drop  across  the  liquid  crystal  layer  and  driving 
the  liquid  crystal  into  its  activated  state.  Thus,  due  to  the  VGM  effect,  the 
photoconductor  converts  an  input  intensity  distribution  into  a  local  variation  of  the  phase 
grating  spatial  frequency.  The  variation  of  optical  frequency  with  voltage  across  the 
liquid  crystal  layer  is  quite  linear  for  a  wide  range  of  VGM  liquid  crystals,  as  shown  in 
Figure  27.  The  fundamental  origin  of  the  VGM  effect  is  not  well  understood,  and  is  the 


DEVICE  RESPONSE  CURVES  FOR  3-SIT  A/D 


Figure  24.  Nonlinear  characteristic 
curves  required  for  the  three-bit  Gray 
code.  Solid  curves  are  the  desired 
characteristics  for  the  bit  plane  outputs. 
Dashed  curves  are  the  ideal  responses  of  a 
multiple  period  liquid  crystal  light  valve. 
Parts  (a)  through  (c)  represent  increasingly 
significant  output  bits.  (After  Armand, 

Ref.  41). 


Figure  25.  Response  curve  of  the  multiple 
period  liquid  crystal  device  used  for  the 
three-bit  A/D  conversion.  The  solid  curve 
is  the  measured  response.  The  dashed 
curve  represents  the  same  response  with 
a  fixed  attenuation  of  the  input. 

(After  Armand,  Ref.  41). 
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Figure  26.  Schematic  diagram  of  the 
Variable Grating  Mode  liquid  crystal 
device.  (After  Soffer,  Ref.  43). 
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Figure  27.  Spatial  frequency  of  VGM 
domains  as  a  furction  of  applied  voltage 
for  various  liquid  crystals.  (After 
Soffer,  Ref.  43) . 
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Figure  28.  Nonlinear  processing 
utilizing  the  intensity-to-spatial 
frequency  conversion  characteristic  of  the 
VGM  liquid  crystal  device.  (After  Soffer, 
Ref.  44). 
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Figure  29.  Logic  functions  as  simple 
nonlinearities .  Given  an  input  consisting 
of  the  sum  of  two  binary  inputs,  different 
logical  operations  can  be  effected  by 
means  of  the  depicted  nonlinear  charac¬ 
teristics.  (After  Chavel,  Ref.  42). 


subject  of  current  investigation. 


The  intensity-to-spatial  frequency  conversion  capability  of  the  VGM  device  allows  the 
implementation  of  arbitrary  point  nonlinearities  with  simple  Fourier  plane  filters.  As 
discussed  above,  when  an  input  image  illuminates  the  photoconductive  layer  of  this  device, 
the  intensity  variations  of  the  input  image  change  the  local  grating  frequency.  If  conerent 
light  is  utilized  to  Fourier  transform  the  processed  image,  different  spatial  frequency 
components  (corresponding  to  different  input  intensities)  of  the  encoded  image  appear  at 
different  locations  in  the  Fourier  plane.  Thus,  by  placing  appropriate  spatial  filters  in 
this  plane  it  is  possible  to  obtain  different  transformations  of  the  input  intensity  in  the 
output  plane  as  depicted  in  Figure  26.  This  figure  describes  the  variable  grating  mode 
nonlinear  processing  function  graphically.  The  input  intensity  variation  is  converted  to  a 
spatial  frequency  variation  by  the  characteristic  function  of  the  VGM  device  (upper 
right-hand  quadrant).  These  variations  are  Fourier  transformed  by  the  optical  system  and 
the  spectrum  is  modified  by  a  filter  in  the  Fourier  plane  (upper  left-hand  quadrant). 
Finally,  a  square-law-detection  produces  the  intensity  observed  in  the  output  plane  (lower 
left-hand  quadrant).  Considered  together,  these  transformations  yield  the  overall 
nonlinearity  (lower  right-hand  quadrant).  Design  of  a  proper  spatial  filter  for  a  desired 
transformation  is  a  relatively  easy  task.  For  example,  a  level  slice  transformation 
requires  only  a  simple  slit  that  passes  a  certain  frequency  band  or  bands. 

To  visualize  how  the  VGM  device  can  be  used  to  implement  logic  operations,  one  need 
only  realize  that  the  function  of  a  logic  circuit  can  be  represented  as  a  simple  binary 
nonlinearity.  The  input-output  characteristics  of  the  common  logic  functions  are  shown  in 
Figure  29.  The  input  in  this  figure  is  the  simple  arithmetic  sum  of  two  input  image 
intensities  corresponding  to  logic  levels  0  or  1,  as  shown  in  the  experimental  arrangement 
depicted  in  Figure  30.  For  example,  NOT  is  simply  a  hard-clipping  inverter,  AND  and  OK  are 
hard-clippers  with  different  thresholds  and  XOR  is  a  level  slice  function.  In  the  VGh 
approach,  such  binary  nonlinearities  can  be  directly  implemented  by  means  of  simple  slit 
apertures  (41).  Thus  the  particular  binary  logic  function  implemented  is  fully  programmable 
merely  by  altering  the  (low  resolution)  Fourier  plane  filter.  In  addition,  the  input  and 
output  functions  are  physically  separate,  which  provides  for  the  possibility  of  level 
restoration  of  degraded  Inputs.  This  feature  is  essential  to  the  production  of  a  reliable 
logic  system  that  is  immune  to  noise  and  systematic  errors. 

Many  logic  functions  which  would  normally  require  multiple  gates  to  implement  can  be 
obtained  directly  with  a  single  VGM  cell.  An  important  example  is  the  full-adder  where  two 
input  bit  planes  and  the  carry  bit  plane  are  imaged  simultaneously  onto  the  VGM  device, 
generating  four  possible  input  intensity  levels  as  shown  in  Figure  31.  The  four  resulting 
diffracted  orders  can  be  filtered  to  generate  the  sum  bit  plane  using  the  positive  orders 
and  simultaneously  the  carry  bit  plane  using  the  negative  orders.  Thus,  a  full  addition  can 
be  performed  in  a  single  pass  through  the  device.  Functions  requiring  matrix-addressable 
look-up  tables  can  be  generated  by  utilizing  two  orthogonally  oriented  VGM  devices  in 
conjunction  with  a  two-dimensional  Fourier  plane  filter.  Several  such  functions  are 
required  for  optical  implementation  of  residue  arithmetic.  Finally,  in  addition  to  the 
combinatorial  log'.c  functions  discussed  above,  sequential  logic  may  also  be  implemented  with 
appropriate  feedback. 


Beam 


Figure  30.  Experimental  arrangement  for 
performing  logical  operations  on  2-D 
binary  inputs  with  a  VGM  device.  (After 
Chavel,  Ref.  42). 


Figure  31.  Implementation  of  a  single 
pass  full  adder  with  a  VGM  device.  The 
inputs  A  and  B  represent  two  binary 
images  (bit-pianos)  to  be  added,  while 
input  C  represents  tne  carry-bit-plane 
from  the  previous  operation. 
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The  wide  range  of  nonlinear  optical  processing  applications  described  above 
demonstrates  the  tremendous  flexibility  inherent  in  the  intensity-to-spatial  frequency 
conversion  process.  It  is  unfortunate  that  at  present,  the  VGM  device  represents  the  only 
available  real  time  implementation  of  this  operation.  The  present  major  shortcomings  of  the 
device  are  grating  imperfections  (which  give  rise  to  broadening  of  the  diffracted  orders) , 
speed  of  response  (on  the  order  of  one  second) ,  and  lifetime.  Improvements  in  all  of  these 
areas  may  be  anticipated,  since  the  VGM  liquid  crystal  device  is  at  an  early  stage  of 
development . 

V.  Photoref ractive  Spatial  Light  Modulators 

Until  quite  recently,  the  recording  of  volume  holograms  in  photoref ractive  materials 
has  been  primarily  investigated  for  applications  in  archival  storage  and  high  resolution 
holographic  memories.  Applications  to  coherent  optical  processing  were  limited  by  extremely 
low  writing  sensitivities  in  available  electrooptic  materials.  Recentlv.  however,  a  number 
of  electrooptic  materials  have  been  investigated  which  exhibit  holographic  recording 
sensitivities  comparable  to  that  of  photographic  film,  including  iron-doped  lithium  niobate 
(45),  strontium  barium  niobate  (45),  bismuth  silicon  oxide  and  bismuth  germanium  oxide  (47), 
and  barium  titanate  (48).  The  availability  of  appropriate  materials  for  real  time  volume 
holographic  storage  has  spawned  interest  in  several  optical  data  processing  applications, 
incuding  phase-conjugate  wavefront  generation  (49),  double-exposure  and  time  average 
holographic  interferometry  for  non-destructive  testing  (50,51),  real  time 
correlation/convolution  (52,53),  and  edge  enhancement  (54,55).  The  use  of  photoref ractive 
materials  as  spatial  light  modulators  necessitates  the  use  of  coherent  input  and  output 
beams,  and  as  such  represents  a  departure  from  the  traditional  function  of 
incoherent-to-cohere'nt  conversion  in  SLM's.  However,  such  devices  may  be  utilized  as 
Fourier  plane  holographic  filters  in  conjunction  with  an  incoherent-to-coherent  or 
electron-beam-addressed  SLM,  and  in  applications  (such  as  multiple  exposure  holographic 
interferometry  and  phase-conjugate  wavefront  generation)  requiring  coherent  sources. 

The  physical  origin  of  the  photoref ractive  effect  is  shown  schematically  in  Figure  32 
(56).  The  intensity  interference  pattern  of  two  monochromatic  coherent  plane  waves  with 
angular  separation  20  is  characterized  by  a  grating  vector  X  »  4x(sin6)/X  oriented 
perpendicular  to  the  acute  bisector  of  the  plane  wave  propagation  vectors.  Within  the 
photoref ractive  material,  either  electron-hole  pair  generation,  or  electron  (hole) 
excitation  from  trap  states  to  the  conduction  (valence)  band,  or  both  may  occur  at  a  rate 
proportional  to  the  local  intensity.  Free  carriers  so  created  will  diffuse  due  to  the 
spatially-varying  concentration  gradient,  and  will  subsequently  be  trapped  preferentially  in 
regions  of  lower  intensity.  This  charge  redistribution  can  be  enhanced  by  application  of  an 
electric  field  parallel  to  the  grating  wave  vector.  The  resultant  spatial  variation  in  the 
charge  distribution  replicates  the  grating  spacing  of  the  intensity  interference  pattern, 
generating  a  periodic  modulation  of  the  local  space  charge  field,  which  in  turn  modulates 
the  local  refractive  indices  through  the  Pockels  (electrooptic)  effect.  The  refractive 
index  grating  so  formed  creates  a  volume  phase  hologram  within  the  bulk  of  the  electrooptic 
material,  which  can  be  read  out  by  a  third  monochromatic  beam  of  appropriate  polarization 
counterpropagating  along  either  of  the  two  writing  beams.  Both  transmission  and  refection 
holograms  may  be  stored  dependent  on  the  orientation  of  the  crystal  with  respect  to  the 
writing  beams,  as  well  as  on  the  included  angle  29.  The  sensitivity  and  maximum  diffraction 
efficiency  of  the  photoref ractive  holographic  storage  process  are  functions  of  the  density 
of  carriers  available  for  photoexcitation,  the  density  of  available  traps  for  charge 
redistribution,  the  magnitude  of  the  electrooptic  coefficient,  the  relative  Intensities  of 
the  writing  beams,  the  magnitude  of  the  applied  field  (if  any),  the  mobility-lifetime 
product  of  the  liberated  photocarriers,  and  the  grating  period,  in  addition  to  numerous 
geometrical  factors.  Simultaneous  optimization  of  these  considerations  places  many 
constraints  on  the  selection  of  appropriate  electrooptic  materials,  and  consequently 
emphasizes  continued  research  on  desirable  material  modifications  (primarily  doping  and 
improvements  in  growth  techniques  for  enhanced  optical  quality)  and  characterization  of  the 
relevant  optoelectronic  properties  of  electrooptic  materials. 

Photoref ractive  materials  have  several  notable  advantages  for  coherent  optical 
processing  applications.  Since  both  image  plane  and  Fourier  plane  holograms  can  be  recorded 
will  equal  ease,  great  flexibility  in  optical  processing  configurations  can  be  made  use  of. 
For  example,  an  optical  system  that  is  capable  of  performing  real  time  correlations  and 
convolutions  i3  shown  schematically  in  Figure  33  (52).  A  similar  system  configuration  that 
allows  implementation  of  image  edge  enhancement  is  shown  schematically  in  Figure  34  (55). 
In  this  latter  application,  use  is  made  of  the  nonlinear  dependence  of  the  diffraction 
efficiency  on  the  modulation  index  of  the  two  writing  beams  by  adjusting  the  reference  beam 
Intensity  to  lie  between  the  bright  and  dark  object  intensity  levels  to  enhance  the 
diffraction  efficiency  in  the  transition  regions  where  the  modulation  index  approaches 
unity.  A  second  notable  feature  of  photoref ractive  materials  is  extremely  high  resolution, 
as  depicted  graphically  in  Figure  35.  The  marked  dependence  of  the  amplitude  modulation 
function  on  the  magnitude  of  the  applied  field  (sue  Figure  35)  allows  the  possibility  of 
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Figure  32.  Schematic  explanation  of  the 
photorefractive  effect.  (After  Kim, 
Ref.  56). 


Figure  33.  Real  time  degenerate  four-wave 
mixing  convolution/correlation  geometry . 
All  input  optical  fields  are  at  frequency 
u.  The  beam  splitter  (BS)  is  necessary 
to  view  the  desired  output,  E3,  which  is 
evaluated  at  a  plane  located  a  distance 
f  from  lens  .  (After  Pepper, Ref.  52). 


Figure  34 .  Experimental  setup  for  real 
time  edge  enhancement  using  the  photo- 
refractive  effect  in  BaTi03-  Writing 
beams  with  intensities  1.  and  I,  (ordinary 
polarization)  and  reading  beam  Pith 
intensity  1,  (extraordinary  polarization) 
are  shown,  as  is  the  C  axis  of  the  BaTiO., 
crystal.  (After  Feinberg,  Ref.  55).  ■ 


Figure  35.  Amplitude  modulation  transfer 
function  for  photorefractive  volume  holo¬ 
graphic  storage  in  Bi,,SiO,n.  (After 
Huignard,  Ref.  57). 
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achieving  spatial  light  modulation  with  essentially  flat  MTF  characteristics  out  to  spatial 
frequencies  in  excess  of  1000  line  pairs/mm. 

VI .  Future  Directions  for  Research 

In  this  concluding  section,  a  number  of  potentially  profitable  directions  for  research 
are  presented  in  addition  to  those  indicated  in  preceeding  sections.  Research  on  the 
fundamental  physical  limitations  of  each  candidate  spatial  light  modulator  technology  is 
critical  both  to  optimization  of  current  device  design  and  performance,  and  to  meaningful 
performance  comparisons  irrespective  of  current  technological  limitations.  Such  comparisons 
are  essential  in  the  assessment  of  the  ultimate  potential  of  each  technological  approach. 
This  research  must  be  broadly  extended  to  include  increased  efforts  in  the  materials  growth, 
deposition,  processing,  and  characterization  areas,  since  most  of  the  devices  discussed 
above  have  been  shown  to  require  relatively  unique  materials  properties  simultaneously  in 
several  distinct  materials  classes  (e.g.,  the  liquid  crystal  light  valves  require  high 
resistivity  photoconductors,  thin  film  blocking  layers,  thin  film  dielectric  mirrors,  and 
appropriate  liquid  crystals).  Very  little  work  to  date  has  been  reported  on  attempts  to 
develop  high  speed  spatial  light  modulators  for  high  frame  rate  applications.  All  of  the 
approaches  described  above  are  inherently  slow  and  cannot  be  expected  to  significantly 
exceed  TV  frame  rates.  Limited  frame  rate  capability  will  become  a  major  bottleneck  in  the 
development  of  advanced  real  time  optical  processing  systems  and  subsystems.  Research  on 
the  optoelectronic  properties  of  photoref ractive  materials  may  yield  improvements  in  both 
sensitivity  and  maximum  diffraction  efficiency.  Realization  of  such  improvements  would 
result  in  widespread  availability  of  inexpensive,  real  time  holographic  storage  and 
processing  devices.  The  enormous  processing  flexibility  for  linear,  nonlinear, 
combinatorial  logic,  and  sequential  logic  point  operations  inherent  in  the 
intensity-to-spatial  frequency  conversion  process  will  hopefully  stimulate  other  possible 
approaches  in  addition  to  that  offered  by  the  variable  grating  mode  liquid  crystal  device. 
In  the  area  of  real  time  parallel  nonlinear  optical  processing,  strong  demand  exists  for 
high  quality  two-dimensional  variable  level  slice  and  threshold  functions.  Although  recent 
progress  in  optical  bistability  has  been  substantial,  most  current  approaches  are  either 
one-dimensional  or  even  single  channel.  Many  •linear"  optical  processing  operations  such  as 
correlation,  convolution,  and  Fourier  plane  filtering  require  some  form  of  threshold  at  the 
output  for  eventual  system  implementation. 
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Discussion  (Armand  R.  Tanquay,  Jr.;  Discussion  Leader:  Cardinal  Warde) 

Q.  You  said  the  Hughes  light  valve  night  have  a  resolution  of  150  lines/ram.  How  large  can  such  a  device 
be  fabricated? 

A.  1"  x  1". 

Q.  Is  that  a  physical  limitation? 

A.  No,  but  with  150  lines/mm  resolution  you  don't  need  more  than  that.  It  is  a  technological  limitation 
in  that  you  need  5  mil  thin,  high  resistivity  wafers  that  you  have  to  get  uniform  to  within  a  percent.  Hold¬ 
ing  onto  a  5  mil  silicon  wafer  is  a  trick  in  itself.  With  a  1"  x  1"  wafer,  you  can  use  a  blocking  wafer  to 

give  it  support,  but  with  a  2"  x  2"  wafer  you  have  serious  problems.  However,  if  you  are  going  to  buy  4 

or  5  million  of  them,  I'm  sure  the  people  in  silicon  technology  would  come  through. 

Q.  Do  you  have  any  data  on  Che  repeatability  of  the  variable  grating  mode  experiments?  Is  temperature 
sensitivity  a  problem? 

A.  Temperature  dependence  is  very  tiny.  The  best  experiment  I  can  give  you  there  is  by  putting  the  device 
under  an  incandescent  lamp  and  a  polarizing  microscope  for  4  or  5  hours,  you  don't  see  any  smearing  or 

deformities.  I  want  to  be  very  careful  to  state  the  case  on  the  variable  grating  mode  device.  This  is  an 

exciting  device,  mostly  because  of  the  intensity  to  spatial  frequency  conversion  that  is  being  done.  It  is 
frightening  to  us  working  on  it  to  think  about  the  number  of  problems  that  need  to  be  overcome.  On  the  other 
hand,  in  the  liquid  crystal  business,  the  situation  with  digital  watches  a  few  years  ago  was  that  they  had  a 
4  or  5  second  turn  on  time,  until  someone  finally  spent  the  money  to  sit  down  and  determine  the  nature  of  the 
situation.  When  they  succeeded  in  this,  the  time  came  down  from  several  seconds  to  on  the  order  of  microsec¬ 
onds.  We  don't  know  what  the  nature  of  the  variable  grating  mode  is  at  all.  We  know  a  lot  of  things  about 
it,  but  we  don't  know  what  the  origin  is. 
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Abstract 

Optical  systems  for  performing  holography  and  optical  processing  are  described.  These 
systems  are  coherent,  but  operate  with  temporally  incoherent  light.  The  noise  suppression 
mechanism  of  the  system  is  analyzed.  In  particular,  a  method  for  deblurring  an  image  is 
given. 


Introduction 


Optical  processing  systems  generally  fall  into  two  categories:  coherent  and  incoherent. 
Out  work  is  on  a  third  ground,  which  partakes  of  both.  We  use  temporally  incoherent  light 
in  an  achromatic  coherent  optical  system. 

As  is  well  known,  coherent  light  has  significant  advantages.  The  use  of  coherent  light 
enables  optical  information  processing  systems  to  perform  sophisticated  operations,  such  as 
spatial  matched  filtering.  However,  the  use  of  coherent  light  results  in  the  introduction 
of  so-called  coherent  noise.  This  noise,  the  manifestation  of  light  from  scatterers  outside 
the  plane  of  the  object,  is  unavoidable,  but  can  be  minimized  by  the  use  of  clean  techniques. 
Even  so,  images  formed  in  coherent  light  are  always  marred  in  appearance  by  this  noise. 

This  problem  can  be  reduced  by  the  use  of  incoherent  techniques.  For  example,  there 
exist  methods  for  making  holograms  and  spatial  filters  with  incoherent  light.  These  tech¬ 
niques  work  in  accordance  with  the  principles  of  incoherent  optics  but,  in  general,  such 
incoherent  systems  have  problems  even  more  severe  than  their  coherent  analogues.  There  is 
the  so-called  bias-buildup  problem,  where,  as  the  number  of  object  points  is  increased,  the 
contrast  of  the  resultant  interference  fringes  decreases.  Since  these  fringes  constitute 
the  recorded  signal,  the  signal  amplitude  is  greatly  decreased,  with  the  result  that  again 
the  signal-to-noise  ratio  is  low. 

In  our  work,  we  carry  out  information  processing  using  temporally  incoherent  light,  but 
in  a  manner  such  that  the  light  obeys  the  principles  of  coherent  rather  than  incoherent, 
optics.  That  is,  the  optical  system  is  linear  in  complex  amplitude  rather  them  intensity. 

In  this  manner  we  utilize  the  enromous  advantages  of  coherent  processing,  without  incurring 
the  associated  noise  problems . 

The  need  for  temporal  coherence  in  holography  and  optical  processing  can  be  described 
very  simply:  When  a  polychromatic  source  is  used  in  forming  an  interference  (or  diffraction) 
pattern,  such  as  in  holography,  the  various  wavelength  components  produce  fringe  patterns 
which  do  not  coincide;  hence  the  resultant  fringe  pattern,  the  superposition  of  the  fringes 
formed  by  all  wavelengths,  will  generally  be  reduced  in  contrast.  The  task  in  eliminating 
the  temporal  coherence  requirement,  then,  is  to  modify  the  fringe-forming  system  so  that  the 
fringes  formed  by  each  wavelength  component  are  scaled  alike  and  are  in  registry. 

We  describe  an  optical  system  which  accomplishes  this  achromatization .  This  system  can 
be  implemented  either  as  an  optical  data  processing  system  or  as  a  hologram  recording  system. 
Indeed,  as  will  be  seen,  in  their  implementation  the  distinction  between  the  holographic 
system  and  the  image  processing  system  disappears. 

The  basic  method 

The  basic  system  for  performing  either  holography  or  optical  processing  is  shown  in 
Figs.  1  and  2.  Figure  1  applies  to  the  holographic  application.  The  transparency  f(x)  is 
illuminated  with  a  polychromatic  light  source  that  is  wavelength-dispersed  along  the  longi¬ 
tudinal,  or  z,  axis.  For  wavelength  Xj,  the  source  is  a  point  a  distance  zsj  from  the 
object;  for  a  wavelength  X2,  the  source  is  a  different  distance,  zS2<  from  the  object.  The 
source  may  be  written  as  the  function 

S  -  6 (z  -  z8X0/X) ,  (1) 

which  indicates  that  the  source  point,  as  a  function  of  wavelength,  is  located  at  z“(Xo/^>zs' 
where  zg  is  the  distance  between  source  and  object  for  wavelength  Xq.  Such  a  source  can  be 
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produced  by  illuminating  a  Fresnel  zone  plate  with  a  point  white  light  source  and  selecting 
one  order  while  removing  the  others  by  appropriate  spatial  filtering. 


We  proceed  to  show  how  to  form  a  holoqram  with  this  arrangement.  For  simplicity,  we 
form  first  a  simple  Gabor  in-line  hologram.  Illuminating  the  object  transparency  is  a  beam 
exp(trx2/’>z) ,  which,  using  the  relation  z*(Xq/X)zs,  becomes  exp(iirx2/Xnzs)  ;  thus,  the  form 
of  the  illuminating  function  is  now  wavelength  independent.  A  lens  L  forms  the  Fourier 
transform  of  the  product  [f  (x)  exp  (itx2/Xozs)  ] ,  and  we  observe  in  the  back  focal  plane  the 
field  distribution 


f  (x1  ) 


2F(  f  (x  -  x')exp(i^x  /XQzg) 


1 . 


(2) 


where  x'  describes  movement  of  f(x)  through  the  optical  system  aperture.  However,  we  con¬ 
fine  our  observation  to  a  point  on  axis  by  placing  at  the  back  focal  plane  of  the  lens  a 
mask  containing  a  pinhole.  The  field  in  the  pinhole  represents  the  integral 

f'(x')  -  /f(x  -  x1 )exp (iwx2/XQza) dx  ■  f *h.  (3) 


We  have  thus  formed  the  convolution  operation  describing  Fresnel  diffraction,  and  it  is 
significant  to  note  that  it  has  been  formed  achromatically,  using  a  broad-spectrum 
source,  of  course,  it  is  generated  one  point  at  a  time,  and  to  generate  the  entire  pattern, 
we  must  move  the  object  transparency  through  the  aperture. 

This  diffraction  pattern  can  be  recorded  as  a  hologram  by  introducing  a  reference  beam 
u0=a0  exp(i2TTfox‘ ) ,  producing  an  irradiance  |uQ+f'|2,  which  results  in  a  hologram  that 
produces  the  desired  reconstructed  wave.  By  using  an  achromatic  interferometer  to  provide 
the  two  beams,  object  and  reference,  the  recombination  of  the  beams  is  accomplished  achro¬ 
matically,  as  we  explain  later. 

Explicitly  showing  the  zone  plate  which  provides  the  dispersed  source  for  the  object 
leads  to  an  alternative  way  (Fig.  2)  of  describing  this  holographic  process.  The  zone 
plate,  whose  amplitude  transmittance  is  ta»l/2 U+cos (tx2/Xqzs) ] ,  is  imaged  onto  the  trans¬ 
parency  f(x).  We  suppose  that  in  the  process  the  zone  plate  is  spatially  filtered  so  that 
only  the  virtual  image  term  reaches  the  transparency  f(x).  Thus,  the  light  distribution 
impinging  on  the  transparency  is,  to  within  a  constant,  exp (iirx2/XQZs )»  which  is  the  result 
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Fig.  1.  Achromatic  holographic 
configuration. 
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Fig.  2.  Alternate  holographic 
configuration . 


given  previously.  A  more  complete  description  is  given  in  Refs.  1  and  2.  By  formulating 
the  operation  in  this  manner,  it  is  seen  to  be  just  the  basic  method  of  using  a  coherent 
optical  system  to  convolve  two  functions  by  imaging  one  onto  the  other.  The  holographic 
process  is  then  just  the  special  case  of  choosing  the  convolving  impulse  response  as  a 
quadratic  phase  function.  We  could  use  any  other  convolving  function;  thus,  the  method 
we  describe  in  terms  of  holography  is  indeed  a  very  general  method  for  using  optical  pro¬ 
testing  for  performing  the  general  operation  g»f*h,  where  f  and  h  are  any  functions. 


Noise-suppression  characteristics 

There  are  a  number  of  noise-suppress Lon  mechanisms  inherent  in  the  achromatic  system. 

-  -oat  obvious  and  simple  one  is  that  since  we  take  the  output  at  a  single  point,  spatial 
«*  -  x,y>  at  any  arbitrary  plane  in  the  optical  system  will  be  transformed  into  a  spatial 
«-  x . y >  at  the  output  and  will  become  just  a  constant  n'(0,0)  at  the  output  point. 

•  «  '!•»*• -.on  mechanism  does  not  depend  on  the  broadband  illumination  and  would  be  the 

i-  -ptical  correlator  which  used  point  readout  instead  of  spatial  readout.  It 

presumably  offer  noise-suppression  performance  as  a  hologram-forming  system 
*  -•  .  • -  -he  isual  holographic  systems,  which  utilize  spatial  readout.  The  noise 
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problem,  however,  is  by  no  means  eliminated  by  the  point  readout,  and  perhaps  not  even 
significantly  reduced,  for  several  reasons.  First,  in  some  cases  in  optical  processing, 
the  output  in  such  "point  output"  correlators  is  not  taken  from  a  single  point,  but  from 
some  surrounding  region,  for  which  the  achromatic  and  other  requirements  are  approximately 
correct.  Second,  in  some  cases  the  operation  to  be  performed  between  object  and  output 
planes  is  one-dimensional,  with  an  imaging  process  being  performed  in  the  other  dimensions. 
Thus,  the  output  is  taken  along  a  line,  and  there  will  in  general  be  a  noise  spatial 
fluctuation  n' (0,y)  [or  n' (x,0) ]  along  this  line.  Finally,  much  of  the  noise  is  signal- 
dependent  noise,  resulting  from  light  which  interacts  with  both  the  object  transparency  and 
the  noise  scatterers,  and  will  thus  vary  as  the  output  film  record  is  scanned  past  the  out¬ 
put  point. 

In  general,  the  noise  suppression  of  the  achromatic  coherent  system  is  dependent  upon 
the  specific  operation  that  the  system  performs.  He  now  begin  discussion  of  the  noise- 
suppression  mechanisms  for  the  achromatic  system  for  holography. 


Fig.  3.  Configuration  for  noise  analysis. 

The  signal  f(x),  which  is  to  be  recorded  as  a  hologram,  will  in  practice  contain  a  bias 
term  fb  and  a  spatially  varying  term  £s(x).  Thus,  f(x)  is  of  the  form  f (x)*fb+f6 (x) .  As 
the  light  from  the  noise  scatterers  passes  through  the  signal  plane,  it  interacts  with  the 
bias  term  to  continue  as  signal-independent  noise  and  also  produces  signal-dependent  noise 
through  interaction  with  the  spatially  varying  term. 

Now  consider  the  reduction  of  the  signal-independent  noise  achieved  by  broadening  the 
spectral  bandwidth  of  the  source.  Let  the  noise  be  any  variation  of  transmittance  in  a 
plane  other  than  the  object  and  output  planes.  Such  noise  could,  for  example,  be  from 
dust,  scratches  on  glass,  bubbles  in  glass,  and  so  forth.  Considering  the  achromatic 
system  of  Fig.  1,  let  the  noise  originate  in  a  plane  a  distance  zn  from  the  object  plane, 
as  shown  in  Fig.  3.  The  field  illuminating  this  plane  is,  for  any  wavelength  X, 

un-(x)  «  exp[iirx2/X(z  +  z  )],  (4) 

which  can  be  written 

un-(x)  “  exp[iirx2/(XQZ8  +  Xzn)].  (5) 

Consider  for  the  moment,  for  purposes  of  analysis,  this  noise  source  to  move  through  the 
optical  system,  as  does  the  object  signal.  Then  the  field  just  to  the  right  of  the  noise 
plane  is 

un+(x)  «  n(x  -  x')exp[i^x2/(X0z8  +  Xzn>],  (6) 

where  the  x'  coordinate  is  the  shift  of  the  object  signal  (and  the  output  signal)  with 
respect  to  the  optical  system.  The  output  amplitude,  for  any  wavelength  X,  taken  at  the 
achromatic  point  in  the  output  plane  becomes 

uQut(x',X)  -  n(x  -  x')exp[iirx2/(X0zg  +  Xzn)]dx,  (7) 

where  here  the  wavelength  dependence  is  shown  explicitly  to  emphasize  that  the  output  ampli¬ 
tude  varies  as  a  function  of  X.  Note  that  the  output  does  not  depend  on  the  distance 
between  the  signal  plane  and  the  correlating  lens. 

Using  again  the  Fourier  transform  relation  n*h  «  £7 { NH ) ,  we  can  rewrite  Eg.  (7)  as 
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N(V 

*  exp(-iir  (Xnz  +  Xz  )  f^]  exp  ( i2irf  s ' )  df  . 

v  9  n  x  x  x 


(8) 


In  the  formation  of  a  hologram,  this  noise  signal,  along  with  the  object  signal,  is  combined 
with  a  reference  function,  recorded,  and  then  regenerated  by  the  hologram. 

If  we  broaden  the  source  spectrum,  integrating  Eq.  (8)  over  a  band  of  wavelengths  gives 


(9) 
(9) 

the  average  output  amplitude.  Interchanging  the  order  of  integration  and  performing  the 
integration  on  X ,  we  find 

“out1*'  ,AX1  =/  N(fx)H2(fx)exp(i2TTfxx1)dfx 


uout(x’'AX) 


J  d X  /  df  8(f  ) 

XQ-AX/X2  •'-«  x  x 
*  exp  [-it  <  X-Zg  +  Xzn)  fj"]  exp  (i2irf xx ' )  , 


=  3'"1lN(fx)H2(fx)],  (10) 

where 

H ( f x>  -  AXexp(-iTr(X0zg)  fx]sinc[znfxiX/2] . 

we  see  that  this  transfer  function  is  centered  at  the  plane  zp»0,  the  plane  of  the  object 
signal,  and  decreases  for  values  of  zn  outside  this  plane.  Thus  under  broad  source  illumi¬ 
nation,  we  suppress  noise  from  all  planes,  not  just  planes  to  one  side  of  the  object  plane. 
Also,  the  signal  is  not  at  all  suppressed  by  the  broadband  spectrum.  We  have  therefore 
achieved  our  objective;  we  have  made  a  coherent  optical  processing  system  that  behaves  like 
an  incoherently  illuminated  imaging  system  in  its  noise  suppression. 

This  system  is  in  sharp  contrast  to  the  conventional  holographic  system,  where  H  is 
centered  at  the  recording  plane  under  other  polychromatic  illumination,  and  signal  from  the 
object  plane  is  attenuated. 

Introduction  of  the  reference  beam 

To  complete  the  achromatic  holographic  system  of  Fig.  1  (or  2)  we  must  bring  in  a  white 
light  reference  beam  that  is  coherent  with  the  signal  beam.  This  is  not  a  simple  task.  It 
can  be  done  by  achromatic  interferometry.  The  resulting  system  is  shown  in  Fig.  4.  Three 
diffraction  gratings  have  been  incorporated  into  the  system  for  generation  of  the  Fresnel 
diffraction  pattern.  The  system  is  a  three  grating  interferometer,  as  well  as  an  achromatic 
optical  processor,  with  both  aspects  being  thoroughly  integrated.  The  theory  of  the  three 
grating  interferometer  has  been  given  elsewhere.3 

In  the  system  of  Fig.  4  (a  system  for  making  one-dimensionally  dispersed  holograms, 
such  as  multiplex  or  rainbow  holograms) ,  we  have  an  optical  processing  system  identical 
with  that  of  Fig.  2,  except  for  the  addition  of  a  cylindrical  lens  Lj  (so  as  to  produce 
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Fig.  4.  Three-grating  device. 
Note  that  L3  is  a  cylindrical  lens. 
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one-dimensional  dispersion).  G2  and  G3  are  identical  gratings  of  spatial  frequency  f^,  and 
Gi  is  an  off-axis  zone  plate  structure,  with  carrier  f  in  the  y  direction  and  the  zone 
plate  structure  in  the  x  direction.  The  zero  and  first  orders  of  Gi  are  selected,  with 
the  first  order  being  modulated  by  the  zone  plate.  G2  demodulates  the  diffracted  beam  to 
zero  spatial  frequency  in  the  y  direction.  Since  G2  affects  the  light  distribution  in  the 
y  direction  only,  G3  can  be  considered  to  be  imaged  in  the  x  dimension  at  object  plane  P2 
producing  the  required  object  distribution.  The  input  is  then  processed  as  described 
earlier,  while  G3  modulates  the  reference  beam  in  order  to  produce  the  required  fringes 
at  the  output  plane.  The  advantages  of  this  system  are: 

(a)  s(x,y)  is  imaged  in  the  y  dimension  at  the  output  plane. 

(b)  The  object  beam  is  undispersed  between  the  object  and  recording  planes.  Previous 
analyses  of  achromatic  grating  interferometers  for  holography  indicate  that  an  undispersed 
object  beam  is  best. 

(c)  High  spatial  frequency  fringes  are  possible. 

(d)  Reference  and  object  beams  are  spatially  separated  at  the  input  plane. 

Disadvantages  of  the  system  are: 

(a)  The  required  spatial  frequency  of  the  gratings  is  closely  tied  to  the  system  mag¬ 
nification.  For  example,  if  G3  and  G3  are  of  the  same  spatial  frequency,  the  lens  system 
must  produce,  to  great  exactness,  unity  magnification. 

(b)  Alignment  is  very  error  sensitive. 

(c)  Light  throughput  is  reduced  because  of  the  multiplicity  of  diffracting  elements. 

We  note  that  r  can  be  other  than  a  zone  plate,  which  would  result  in  generalized  holo¬ 
grams,  in  which  each  object  point  on  the  hologram  becomes  a  spread  function  that  is  other 
than  a  zone  plate.  Also,  if  using  modern  techniques  for  production  of  phase  transparencies 
we  could  generate  the  transparency  r<j  directly,  r^  could  be  superimposed  on  s,  and  the 
system  would  thereby  be  simplified. 


Fig.  5.  Achromatic  fringes  (150  Fig.  6.  Output  from  a  slit  signal, 

lines/mm)  produced  by 
the  three-grating  system 

Fringes  formed  by  the  system,  for  the  case  of  no  signal,  are  shown  in  Fig.  5.  The 
spatial  frequency  of  the  fringes  is  in  excess  of  that  permitted  by  the  optical  transfer 
function,  and  the  fringes  are  of  high  contrast.  Fig.  6  shows  the  diffraction  patterns  of 
a  slit,  along  with  the  fringes  formed  by  the  reference  beam.  This  distribution,  if 
recorded,  would  be  the  hologram  of  a  slit. 
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Finally,  we  show  how  to  use  the  achromatic  device  to  deblur  images.  Here,  the  system 
functions  as  an  optical  processor  only,  and  the  reference  beam  is  not  required.  This  is  of 
course  an  enormously  simpler  system  than  for  the  case  of  making  a  hologram. 

The  system  is  shown  in  Fig.  7.  The  theory  of  operation  is  as  follows.  We  assume  the 
images  to  be  degraded  by  one-dimensional  blurring,  such  as  would  arise  if  the  image  moved 
linearly  relative  to  the  recording  device  during  the  recording  process.  Let  the  point- 
spread  function  of  the  blurring  process  be  the  rectangular  function  rect  x/L,  where  L  is 
the  width  of  the  blur  (here  taken  along  the  direction  x) . 

The  blurred  image,  with  transmittance  s(x,y),  can  be  deblurred  to  produce  an  image 
approximating  an  original  unblurred  image  by  convolving  with  a  restoring  function  m(x,y) , 

u(x,y)  *  ys (a  -  x,y)m(a,y)da  (ID 

”  s  *  m, 

where  a  is  a  dummy  variable. 

This  basic  deblurring  problem,  in  which  the  blur  process  is  characterized  by  a  rect 
function,  has  been  treated  many  times.  Swindell4  describes  heuristically  an  algorithm  for 
the  restoration  process  that  assumes  the  function  m  to  be  a  sequence  of  pulses  of  opposite 
polarity,  as  shown  in  Fig.  1.  The  pulse  periodicity  is  chosen  to  be  exactly  the  blur  width. 
The  convolution  is  readily  carried  out  mentally  by  imagining  the  blurred  image  of  a  point 
(the  rectangle  s)  sliding  across  m.  The  convolution  integral  u  is  generally  zero,  with 
three  exceptions.  At  x-0 ,  the  mask  is  positioned  as  the  center  of  the  pattern,  so  the 
blurred  image  falls  on  two  positive  pulses  and  the  integral  is  therefore  not  zero.  Also, 
for  a  displacement  x  that  places  the  blurred  image  at  the  edge  of  the  function  m  so  the 
blurred  image  overlaps  only  the  final  pulse,  the  integral  is  again  nonzero.  Each  response 
represents  the  restored  image.  That  each  such  blurred  object  point  results  in  three 
restored  images  causes  no  problem  provided  that  the  mask  m  is  larger  than  the  extent  of  the 
image.  Then  the  various  deblurred  images  will  not  overlap. 


Fig.  7.  Optical  processing  system.  S  is  the  light  source,  L^; 

L2 ,  L3,  and  La  are  lenses;  CL  is  a  cylindrical  lens; 
is  a  spatial  filter  (a  stop) ;  and  Sj  is  a  slit. 

We  describe  a  simple  method  for  carrying  out  the  deblurring  process  optically,  wherein 
the  deblurring  function  m  is  produced  from  simple,  readily  available  diffraction  gratings, 
such  as  Ronchi  rulings.’  The  optical -processing  system  is  shown  in  Fig.  7.  The  function 
m  (at  Pi)  is  imaged  at  s  (at  P2 ) ,  which  is  moved  through  the  optical -system  aperture. 
Following  s  is  a  cylindrical-spherical-lens  combination  (CL,  L4) ,  followed  by  a  slit  in 
the  back  focal  plane  of  the  second  Lens.  A  moving  film  or  other  detector  records  the 
light  in  the  slit.  The  system  is  illuminated  with  coherent  light.  This  optical  system 
generates  the  function 

u(x,y)  ■  s  *  ra, 

where  the  convolution  is  on  x  only.  The  system,  in  the  y  dimension,  is  a  straightforward 
imaging  system,  with  L3  and  L,  imaging  s  onto  the  slit. 

The  function  m  is  derived  from  a  Ronchi  ruling  r  at  the  back  focal  plane  of  L^.  The 
Ronchi  ruling  consists  of  opaque  and  transparent  bars  with  sharp  transitions  [Fig.  9(a)]. 
The  required  function  m(x)  is  derived  from  the  grating  by  a  spatial  filter  that  forms  the 
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second  derivative  of  r.  We  describe  (again  heuristically )  the  spatial-filtering  process. 
The  first  derivative  of  a  square  wave  [Fig.  9(b)]  is  ideally  a  sequence  of  6  functions 
located  at  the  transition  regions  of  m  and  alternating  in  sign.  In  Fig.  9(c)  we  show  the 
second  derviative,  wherein  each  pulse  in  b  is  converted  into  two  abutting  pulses  of 
opposite  polarity.  In  practice,  of  course,  the  spatial-filtering  process  will  have  a  fin¬ 
ite  spatial-frequency  bandwidth. 
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Fig.  8.  Deconvolution  of  a  Fig.  9.  Derivation  of  deblurring 

linear  blur  (after  function  from  Ronchi  grating. 

Swindell) . 

The  spatial  filter  that  produces  the  second  derivative  is 

H  -  Cfx2.  (13) 

where  C  is  a  constant.  Such  a  mask,  appropriately  truncated  to  avoid  infinities,  is 
required  at  the  back  focal  plane  of  As  a  practical  matter,  a  binary  approximation  to 

H  is  satisfactory  and  is  even  easier  to  implement.  Such  a  filter  would  consist  of  a  stop 
at  the  center  of  the  grating  diffraction  pattern,  blocking  out  some  of  the  lower  orders 
while  the  higher  orders  are  passed  without  attenuation. 

Closer  inspection  reveals  that  the  pulse  sequence  of  Fig.  9(c)  is  not  quite  right. 
Alternate  pulse  pairs  are  oppositely  polarized;  one  pulse  pair,  produced  from  a  left-hand 
edge  of  the  transparent  grating  slit,  has  the  positive  pulse  on  the  left  and  negative  one 
on  the  right.  The  adjacent  pulse  pairs  are  the  reverse.  This  problem  is  corrected  by 
placing  a  second  Ronchi  ruling  at  the  signal  plane,  positioned  to  block  alternate  pulse 
pairs.  Thus  the  signal  s  sees  only  the  desired  function,  shown  in  Fig.  9(e).  Correlation 
with  such  a  function  will  produce  a  pair  of  deblurred  images  separated  by  a  distance  equal 
to  the  width  of  the  grating. 

This  system  has  been  experimentally  verified  by  using  a  slit  to  represent  the  blurred 
image  of  a  line  object.  The  results  are  just  as  theory  predicts.  We  presently  are  working 
on  a  full  deblurring  experiment. 

Thus,  we  have  shown  how  to  perform  holography  or  optical  processing  using  white  light, 
and  we  have  demonstrated  a  noise  reduction  mechanism  for  this  process. 
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Discussion  (Emmett  N.  Leith;  Discussion  Leader:  Steven  K.  Case) 

Q.  Can  you  tell  us  something  about  the  diffraction  gratings?  Are  they  holographic? 

A.  Yes.  It  is  all  we  can  reasonably  afford,  and  they  are  quite  suitable  because  you  can  tailor  them  to 
your  needs.  You  can  put  however  much  light  you  want  in  any  given  order  and  you  don't  need  extremely  high 
quality  gratings.  However,  making  them  is  rather  difficult  because  if  you  look  at  the  parameters  that 
describe  what  you  need  for  achromatization,  it  is  very  severe.  For  example,  of  the  three  gratings,  it  turns 
out  that  two  must  be  of  exactly  the  same  spatial  frequency.  But  that  is  assuming  that  the  two  lenses  that 
are  between  have  exactly  the  same  focal  length,  and  tolerances  of  lens  manufacturers  are  not  that  great.  So 
if  the  lenses  differ,  you  have  to  make  the  gratings  differ  by  the  same  amount.  What  you  do  is  make  a  first 
grating,  then  to  make  the  second  grating  you  use  Moire  techniques  to  see  exactly  the  spatial  frequency  that 
you  want.  Then  you  have  to  take  into  account  magnification  by  the  lenses  in  the  system,  because  the  final 
grating  has  to  match  the  spatial  frequency  of  the  first  grating  per  se,  so  the  whole  thing  is  fraught  with 
problems. 
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I.  Introduction 

Light  diffracted  by  an  acoustic  wave  signal  will  contain  the  phase,  amplitude,  and  frequency  information 
of  that  signal,  so  it  would  appear  that  this  interaction  should  be  a  naturally  attractive  basis  for  signal 
processing.  The  history  of  acousto-optic  processing  oould  be  considered  to  originate  as  far  back  as  1932 
with  the  experimental  verification  of  light  diffraction  by  sound  waves  by  Debye  and  Sears,  since  the  accusto- 
optic  deflector  is  the  elementary  building  block  for  such  processing.  The  practicality  of  acousto-optic  pro¬ 
cessing  was,  however,  greatly  enhanced  by  a  lumber  of  technological  innovations,  especially  the  advent  of  the 
laser,  progress  in  the  growth  of  good  crystals  of  accusto-optic  materials,  and  progress  in  the  fabrication  and 
design  of  acoustic  delay  lines.  Several  of  these  innovations,  aside  from  their  relevance  to  acousto-optics, 
have  spurred  work  in  information  processing  along  well-known  courses,  e.g. ,  optical  processing  via  two-dimen¬ 
sional  transforms  using  lenses  and  spatial  light  modulations,  and  signal  processing  using  acoustic  filters, 
especially  surface  acoustic  wave (SAW)  filters.  It  is  the  purpose  of  this  paper  to  review  acousto-optic 
approaches  to  real-time  signal  processing. 

Che  can  cite  several  general  advantages  of  an  acousto-optic  approach  to  real-time  signed,  processing. 

First,  the  aoousto-optic  interaction  is  approximately  linear  over  a  very  large  dynamic  range.  Unlike  tapped 
delay-line  filters,  there  is  no  loading  of  the  delay-line  material  that  could  result  in  acoustic  velocity 
dispersion  and  signal  attenuation.  Second,  acoustic  delay  lines  can  be  fabricated  with  very  wide  bandwidths 
(  >500  J«z)  and  long  interaction  windows  ('80  ys) .  Flexibility  in  the  design  of  transducers,  particularly  in 
the  case  of  SAW's,  allows  far  prefiltering  of  input  signals.  Finally,  if  one  uses  SAW  delay  lines,  one  has  a 
planar  technology  that  is  inherently  ccnpatible  with  integrated  optics;  hence,  the  optical  portion  of  a  pro¬ 
cessor  could  also  be  made  ocnpact  and  rugged. 

In  the  following,  a  review  of  the  currant  status  of  acousto-optic  deflectors  and  their  application  to 
spectral  analvsis  will  be  given,  followed  by  a  review  of  a  variety  of  acoueto-cptic  signal -processing  concepts 
that  have  been  implemented,  sue*  as  correlators,  Fourier  transformer  devices,  and  triple-product  processors. 

II.  Acousto-Optic  Deflectors  and  Spectral  Analysis 

The  earliest  applications  of  acousto-optic  calls  were  to  the  deflection  and  modulation  of  light.  The  para¬ 
meters  for  optimun  operation  of  deflectors  and  modulators  are  generally  at  variance;1  that  is,  a  good  modu¬ 
lator  will  perform  poorly  as  a  deflector  and  vice  versa.  Since  the  topic  of  spectral  analysis  is  a  major  con¬ 
cern,  only  acousto-optic  deflectors  will  be  considered. 


The  operation  of  an  acousto-optic  deflector  depends  on  the  change  in  deflection  angle  of  the  light  with 
change  in  frequency.  Operation  is  generally  in  the  Bragg  regime,  and  the  angle  of  deflection  is  therefore 
governed  by  the  relation 

«  -  2  sin  *(„drH  -  (1) 
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where  •  is  the  light  wavelength,  n  the  index  of  refraction  of  the  rnsdiun,  v  the  acoustic-wove  velocity,  and 
f  the  frequency  of  the  acoustic  wave.  A  major  attraction  is  that  all  frequencies  contained  in  the  acoustic 
wave  are  displayed  simultaneously.  The  lumber  of  frequencies  that  may  be  resolved  is  limited  by  diffraction 
of  the  light.  If  18  is  the  angular  spread  due  to  a  signal  of  bandwidth  Af,  the  lumber  of  resolvable  frequen¬ 
cy  cells  is  obtained  by  dividing  A9  by  the  diffraction-limited  angular  spread  of  the  light-beam  At  (=>/d, 
where  d  »  the  width  of  the  light  beam) .  The  result  is  the  time-bandwidth  (T-B)  product,  where  the  relevant 
tire  is  the  transit  time  of  the  acoustic  signal  for  a  distance  d.  Other  definitions  of  time-bandwidth  pro¬ 
duct  will  be  given  later.  With  present-day  technology,  time-bandwidth  products  of  about  2000  to  5000  are 
possible.2  Three  parameters  limit  the  ultimate  T-B  product:  length  of  the  delay  line,  atteruation  of  the 
acoustic  wave  by  the  delay-line  neterial,  and  diffraction  of  the  acoustic  wave.  With  improved  crystal  growth 
techniques,  delay  lines  up  to  15  an  long  have  been  grown,  and  for  the  00),  SAW  cut  of  BGO,  this  corresponds  zo 
an  aperture  of  greater  than  80  us.3  Increasing  the  aperture  by  using  materials  with  very  slow  acoustic  veloci¬ 
ties  is  often  hanpered  because  the  attenuation  of  the  acoustic  signal  is  larger  for  such  materials.  For  ex¬ 
ample,  Te02  has  a  shear  mode  velocity  of  only  620  m/s  but  unfortunately  a  large  acoustic  attenuation  (17.9 
dB/s  at  1  GHz)  that  limits  effective  apertures  to  about  50  ~s.’  Attenuation  also  increases  with  the  square 
of  the  acoustic  frequency,  thereby  limiting  bandwidth. 


Acoustic-wave  diffraction  also  results  in  a  limit  or  the  bandwidth.  Normally  the  most  effective  mode  of 
operation  for  a  deflector  is  to  have  a  planar  optical  wave  incident  on  the  acoustic  cell1  at  the  Bragg  anglf. 
For  a  single  acoustic  transducer  with  a  limiting  aperture  L,  the  di f fraction  spread  is  approximately  VL, 
according  to  scalar  diffraction  theory,  where  A  is  the  acoustic  wavelength.  By  differentiation  of  eq.  (1) , 
one  sees  that  the  diffraction  spread  is  equivalent  to  a  bandwidth 
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where  is  the  wavelength  at  center  frequency  f0.  The  bandwidth  is  therefore  a  function  of  the  center  fre¬ 
quency'.  Af/fc  can  be  increased  by  decreasing  L,  but  only  at  the  expense  of  interaction  efficiency  with  the 
optical  beam.  More  desirable  is  to  use  phased  or  tilted  arrays  of  transducers  to  increase  if  while  maintain¬ 
ing  L.5  This  technique  is  especially  suited  to  SAW  implementation,  and  600-fKt  bandwidthshave  been  achieved.6 
Bulk-wave  devices  have  the  advantage  of  higher  center  frequencies  of  operation;  LiKbOj  devices  having  1-GHz 
bandwidths  and  2.3-CHz  center  frequencies  have  been  dgncnstrated . 

One  can  use  an  acousto-optic  deflector  for  rf  spectral  analysis  by  placing  the  acoustic  cell  at  the  front 
focal  plane  of  a  lens.  The  rf  power  spectrum  will  be  displayed  as  a  light- intensity  distribution  at  the  back 
focal  plane  of  the  lens.  Photodetector  arrays  may  be  placed  at  the  back  focal  plane  for  signal  detection. 

The  attractiveness  of  this  implementation  is  nearly  instantaneous  coverage  of  the  full  bandwidth  of  the  de¬ 
vice  input.  However,  several  considerations  should  be  kept  in  mind  when  one  atplcys  this  apparently  simple 
concept.  In  any  acoustic  device  there  is  a  finite  loading  time,  so  that  the  ultimate  resolution  and  signal 
strength  will  not  be  reached  until  the  signal  has  entirely  filled  the  aperture  of  the  acoustic  cell.  For 
pulsed  input  signals ,  it  is  possible  that  the  aperture  will  not  be  filled,  so  even  when  the  signal  has  fully 
entered  the  cell,  the  resultant  (sine)2  light- intensity  functions  at  the  detector  array  (for  uniform  illumina¬ 
tion)  will  be  broader  and  resolution  therefore  poorer.  Also,  if  photodetectian  is  done  with  an  array  that 
integrates  the  light  intensity  for  seme  fixed  amount  of  time  before  readout  (for  processing  gain;  see  section 
III) ,  the  effect  of  the  moving  acoustic  signal  will  be  to  broaden  the  min  peak  and  anooth  the  sidelobes  of 
the  sine  function. 7 

Perhaps  the  most  serious  disadvantage  of  the  spectrum  analyzer  described  above  is  that  although  the  acousto- 
optic  interaction  gives  nearly  100-percent  time  coverage  of  a  frequency  band,  most  detector  arrays  mist  be 
read  out  serially,  and  present-day  shift  registers  cannot  operate  much  faster  than  about  5  (Hz.  Hence,  a 
fraction  of  a  millisecond  must  be  expended  for  each  readout  cycle  of  a  1000-element  array.  An  obvious  solu¬ 
tion  would  be  to  enploy  GaAs  technology  to  produce  faster  readout  circuits;  a  500-Wiz  CCD  array  has  been 
reported. 8  A  second  approach  is  to  use  parallel-processing  electronics.  A  parallel-readout  fiber-optic 
array,  with  each  fiber  connected  to  a  discrete  detector,  is  being  developed ; >  288  fiber  ends  will  be  placed 
contiguously,  and  with  the  PIN  diodes  and  associated  video  amplification,  a  dynamic  range  of  >40  dB  and  a 
response  time  of  <1  us  are  expected. 

If  several  acoustic  signals  of  differing  frequencies  are  present  simultaneously,  cross-modulation  will  re¬ 
sult  in  the  generation  of  intermodulation  beams,  since  the  generation  of  the  various  diffracted  beans  will 
not  be  completely  independent.10  The  case  for  two  accustic  signals  has  been  evaluated;  in  the  Bragg  regime 
it  was  found  that  third-order  intermodulation  reduced  the  spurious-free  dynamic  range  by  20  dB  from  a  poten¬ 
tial  70  dB  in  the  single-signal  case  to  about  50  dB.1!) 

The  light  at  the  back  focal  plane  of  the  spec trun- analyzer  lens  can  also  be  further  processed.  Both  phase 
and  amplitude  information  aze  preserved  at  the  back  focal  plane,  since  the  lens  performs  a  true  Fourier  trans¬ 
formation  an  the  light  beam.  Coherent  detection  at  the  back  focal  plane,  using  a  reference  light  beam,  can 
be  used  to  recreate  the  tine-domain  signal  inserted  into  the  acoustic  cell.  Operations  such  as  filtering, 
weighting,  or  excision  of  interfering  signals  may  be  performed  at  the  frequency  plan  before  the  reconstruction 
of  the  signal. 


Ill,  Accuato-Optic  Processors  and  Architectures 

This  section  will  deal  with  the  various  acousto-optic  devices  other  than  the  sinple  Bragg-cell  spectrum 
analyzer  that  have  been  demonstrated  and  the  performances  that  have  been  achieved  by  then.  These  devices 
are  mainly  correlator /convolvers  or  systems  requiring  the  computation  of  the  aorrelation/oonvolution  integral. 
For  convenience,  devices  will  be  categorized  as  space  integrating  or  time-integrating. 

Space-Integrating  Processors 

Correlation  or  convolution  between  two  signals  can  be  obtained  by  imaging  the  diffracted  light  from  one 
signal  onto  the  other,  provided  one  of  the  signals  is  moving  with  respect  to  the  other.  The  imaging  process, 
resulting  in  doubly  diffracted  light,  provides  the  necessary  multiplicative  operations.  The  doubly  diffracted 
light  nust  then  be  collected  and  focussed  onto  a  photodetector  to  effect  the  integral.  This  Bchone  is 
therefore  termed  space- integrating;  the  oorrelation/oonvoluticn  function  appears  at  the  output  of  the  photo- 
detector  aa  a  function  of  time.  Movement  of  one  signal  with  respect  to  the  other  may  be  achieved  by  trans¬ 
duction  of  one  or  both  signals  into  acoustic  signals.  The  earliest  correlators  used  one  acoustic  signal  and 
one  fixed  referenoe  mask.11  Use  of  two  accustic  signals  eliminates  the  need  for  fabricating  a  photographic 
mask  or  using  a  spatial  light  modulator.  However,  relative  motion  between  the  two  signals  must  be  obtained 
either  by  propagating  the  signals  in  opposing  directions  or  by  having  different  acoustic  velocities  (i.e. , 
materials)  for  the  two  signals.  In  the  farmer  case,  a  convolution  in  a  compressed  time  frame  is  obtained,  un¬ 
less  cne  of  the  signals  is  time  reversed  so  as  to  obtain  correlation.  In  the  latter  case,  correlation  is 
obtained  if  the  length  and  frequencies  of  the  acoustic  signals  are  scaled  inversely  with  the  ratio  of  the 
two  acoustic  velocities. 12  Systems  using  oounterpropagating  signals  have  been  constructed  with  bulk-wave  de¬ 
lay  lines12  and  with  SAW  delay  lines. 3  a  "two-crystal"  correlator  has  been  constructed  with  SAW  lines.12 
Figure  1  illustrates  the  SAW  acousto-optic  convolver. 
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Correlators  and  convolvers  may  be  characterized  by  their  time-bandwidth  product,  as  defined  in  Section  II. 

It  can  be  shown  that  the  T-B  product  is  essentially  proportional  to  the  signal-to-noise  processing  gain  ob¬ 
tainable  in  correlation, 14  provided  the  system  has  dynamic  range  in  excess  of  this  processing  gain.  It  is 
usually  desirable  to  make  this  product  as  large  as  possible.  By  using  large  aperture  delay  lines  and  the 
tilted  SAW  transducer  technique  described  in  section  II,  the  convolver  shown  in  Pig.  1  achieved  a  T-B  product 
of  10,000  (250-t«z  bandwidth,  40- us  aperture) ,  while  the  two-crystal  correlator  achieved  a  T-B  product  of 
3, 000. I2  Limitations  on  T-B  product  are  exactly  those  discussed  in  section  II.  Large  dynamic  range  ( >60  dB) 
is  possible  with  these  acousto-optic  processors,  because  the  frequency  shift  of  the  light  upon  diffraction 
allcws  one  to  use  coherent,  heterodyne  detection.  Hence,  in  Fig.  1,  the  light  beam  Aq,  which  is  undiffracted 

light,  serves  as  the  local  oscillator  for  detecting  the  anplitude  of  the  doubly  diffracted  light  beam  A2. 

A  second  type  of  space-integrating  correlator  which  uses  memory  storage  has  been  developed.15'16  The  basis 
for  this  acousto-optic  memory  correlator  is  the  aoousto-photorefractive  effect,  by  which  an  indeoc-of -refrac¬ 
tion  pattern  corresponding  to  an  rf  signed  is  stored  in  LiNbOj.  Operation  is  similar  to  acousto-cptic  cor¬ 
relators  using  one  fixed  reference  mask  except  that  the  fixed  pattern  is  on  the  same  substrate  as  the  live 
aooustic  signal.  Storage  is  in  YZ  LiNbOg  and  is  effected  by  exposure  of  the  LiNbC>3  to  a  high- intensity , 
short-duration  laser  pulse  simultaneously  with  the  propagation  of  a  SAW  signal  in  the  Z -direction.  The 
laser  light  may  be  either  533  nm  incident  in  the  X-direction  or  1060  ran  incident  in  the  Y-direction.  The  for¬ 
mer  storage  mode  succeeded  in  producing  an  8 -week  storage  time  for  a  7-bit  Barker  code;  storage  times  for  the 

latter  node  are  typically  a  few  hours.  Signals  with  center  frequencies  up  to  90  MHz  hawe  been  successfully 
stored  using  a  3- ns  storage  pulse.  The  dynamic  range  of  this  device  is  about  25  dB.  The  T-B  product  is 
limited  because  only  a  1-mz  bandwidth  has  been  employed  so  far.  However,  there  do  not  appear  to  be  ary 
obstacles  to  storino  at  large  fractional  bandwidths.  It  has  been  verified  that  the  storage  at  1060  ran  is 
due  to  electrons  trapped  on  the  surface  of  the  LiNbC^.  The  source  of  the  electrons  is  most  probably  photo¬ 
emission  frtm  the  LiNbC>3.  Further  work  is  required  to  verify  the  storage  mechanism  and  to  elucidate  the 
cause  for  a  fatiguing  effect  whereby  restorage  is  at  a  lower  efficiency  unless  sufficient  time  has  passed 
(~1  day)  or  the  LiMbOg  has  been  annealed  at  about  250°  C. 

The  acousto-optic  correlator  may  be  used  far  rapid  spectral  analysis  when  it  is  aqployed  as  a  building 
block  for  performing  a  Fourier  transformer  via  the  chirp  transform  algorithm.17  The  Fourier  transform  of  a 
function  x(t>  is  defined  as  » 

X(f)  -1  X(f)  exp(-j^t)  dt  .  (3) 

By  substituting  the  identity  -2ft  =  (f  -  t)2-  f2  -  t2  into  eq.  (3) ,  and  rearranging  terms,  the  following  is 
obtained:  •  *2 

X(f)  -  e"3lTf  f°  [x(t)  exp(-jrt2)l  [axp(jit(f  -  t)2)]  dt  .  (4) 

The  first  bracketed  term  of  the  integral  may  be  identified  as  a  pranul triplication  of  the  function  x(t)  by 
the  oanplex  representation  of  a  linear  FM  chirp.  This  product  is  then  correlated  with  a  ocnplex  chirp,  and 
the  result  is  pos multiplied  by  a  catplex  chirp.  Without  the  last  step  of  postmultiplication,  eq.  (4)  is 
recognized  as  the  principle  of  the  microscan  receiver  which  is  widely  used  for  rapid  spectrum  analysis. 

This  architecture  can  be  inplemented  with  an  acousto-optic  correlator.  Thus,  spectral  analysis  can  be  per¬ 
formed  in  a  time  on  the  order  of  the  propagation  time  of  the  chirp  signals  through  the  acoustic  delay  lines — 
several  tens  of  microseconds  at  most.  During  the  propagation  of  the  chirps,  the  frequency  ocnpanants  are 
cutout  as  a  function  of  time  fron  the  photodetector.  With  a  large  time-bandwidth  processor,  equivalent  amounts 
of  spectral  data  are  obtained  more  rapidly  than  with  the  Bragg  cell  analyzers  described  in  section  II.  Since 
coherent  detection  is  possible  with  the  acousto-optic  correlator,  there  is  also  the  advantage  of  greater  dy¬ 
namic  range  than  with  direct  light  intensity  detection.  Using  a  SAW  acousto-optic  correlator  with  a  T-B 
product  of  1000,  an  instantaneous  bandwidth  of  75  Hiz  and  a  I  inear  dynamic  range  of  67  dB  have  been  achieved. 

It  should  be  noted  that  the  chirp  transform  method  is  more  catplex  than  the  Bragg-cell  analyzer,  especially 
since  the  transform  is  performed  with  a  maxinun  50-percent  duty  factor;  therefore,  two  coupled  channels  are 
required  for  100-percent  coverage.  Also,  this  method  is  theoretically  somewhat  less  capable  than  the  Bragg¬ 
cell  analyzer  in  a  dense  signal  enviroranent  with  multiple  simultaneous  signals. 

The  accuracy  of  the  Fourier  transform  is  limited  by  the  accuracy  of  the  broadband  chirps  required  for  the 
large  T-B  product  correlator,  as  well  as  by  the  optics  (i.e.,  optical  wavefront  distortions) .  Generally,  the 
chirps  are  produced  by  an  impulse-excited  reflective-array  caipressive  SAW  delay  line  which  typically  has  a 
0.1-dB  amplitude  and  1°  phase  error. 

Since  a  true  Fourier  transform  is  performed,  frequency-dcmain  operations  may  be  performed.  However,  in 
contrast  to  the  Bragg-cell  analyzer,  the  operations  are  performed  in  time  rather  than  in  space.  For  example, 
excision  of  a  narrow-band  interference  signal  is  done  by  time-gating  the  photodetector  output  and  reconstruct¬ 
ing  the  time-domain  signed  obtained  by  a  second  chirp-transform  operation. 

A  discrete  Fourier  transform  (DFT)  may  also  be  performed  acousto-optically  using  somewhat  similar  ideas  as 
in  the  continuous  transform.  The  DFT  (denoted  by  Gv)  of  a  sample  sequence  }  is  defined  as 

N-l  /  +,  n 

«k  "  E  gn  (5) 

n»0 

where  n  is  the  total  nuitoer  of  sanples  in  the  sequence.  By  substituting  the  identity 

nk  -  [(k  +  n)2  -  (k  -  n> 2  ] 
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into  eq.  (5)  the  following  equation  results: 

S-l 
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jn(k  -  n) 
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where  the  exponential  terms  in  the  equation  can  be  interpreted  as  being  two  chirp  waves  propagating  in  opposite 
directions.  This  architecture  for  implementing  the  DFT  is  referred  to  as  the  triple-product  convolver  (TPC)19 
and  can  be  realized  acousto-optically.  The  sheet  beam  of  laser  light  used  in  the  acousto-optic  convolver 
(e.g. ,  Fig.  1)  for  the  continuous  transform  is  replaced  by  a  number  of  (N)  discrete,  parallel,  very  narrow 
laser  beams.  These  beams  are  intensity-modulated  (e.g.,  by  electro-optic  modulators)  by  quadrature  signals 
(for  representation  of  both  real  and  imaginary  data) ,  one  for  each  sanple  gn.  Each  beat  is  detected  after  it 
has  interacted  with  two  contratravelling  chirp  waveforms  in  an  acoustic  delay  line  to  form  the  triple  product 
of  gn  and  the  two  chirps.  The  sum  of  the  detected  signals  contains  the  real  and  imaginary  parts  of  the  DFT 
of  the  input  data.  The  sunmation  of  the  beam  outputs  may  be  obtained  either  by  using  N  separate  pnotodetec- 
tors  and  recombining  the  resultant  rf  outputs  or  by  ocmbining  the  separate  optical  beams  onto  a  single  detec¬ 
tor.  The  choice  of  sunmation  method  is  dictated  by  convenience  or  by  which  method  can  be  made  to  result  in 
smaller  errors.  A  simple  eight-beam  acousto-optic  TPC  has  been  constructed  using  a  SAW  device  for  the  chirp 
inputs.  A  real  eight-point  transform  was  performed  with  all  gn  =  constant.  The  detected  envelope  of  the  out¬ 
put  was  in  very  good  agreement  with  the  theoretical  answer 

„  8A„  sin  8kx 

=  ~isns —  -  (7) 

where  A„  is  the  anplitude  of  each  laser  beam  and  x  is  a  constant. 


One  might  note  that  the  TPC  parallel  processes  N  data  saiples  in  the  time  required  for  the  chirps  to  prop¬ 
agate  through  the  acoustic  delay  line.  In  principle,  one  might  process  many  data  points  in  several  micro¬ 
seconds.  In  cases  where  large  amounts  of  data  arrive  serially  at  a  relatively  slew  rate,  instead  of  storing 
the  data  t®pararily  to  be  processed  in  parallel  at  the  end  of  the  collection  time,  one  could  use  a  modified 
TPC  architecture  developed  for  performing  a  very  lone  one-dimensional  transform.  This  modified  architecture 
uses  charge-ccupled  device  chirp— Z  transform  modules  to  modulate  the  light  beams,  with  proper  phasino  between  light 
beams.  The  OCD  modules  have  long  interaction  time  (  10“i  s)  but  snail  bandwidth,  while  the  acousto-optic 
device  has  large  bandwidth  (  109  Hz)  but  relatively  snail  interaction  time.  The  combination  of  these  two  de¬ 
vices  should  result  in  a  processor  with  both  large  bandwidth  and  long  interaction  time. 

The  TPC  architecture  appears  to  be  particularly  amenable  to  an  integrated-optic  inplenentaticn.  One  such 
implementation  is  shewn  in  Fig.  2.  N  laser  diodes  are  coupled  to  N  channel-type  optical  waveguides  on  a  sub¬ 
strate  of  LiHO,  which  acts  as  the  SAW  medium  for  the  chirps.  The  waveguides  would  be  produced  by  titanium  in 
diffusion  into  the  LiNb03.  The  laser  diode  output  intensities  may  be  modulated  directly  by  control  of  the 
diode  current.  Each  laser  beam  nay  be  detected  individually  as  shown,  or  a  geodesic  lens  cam  be  used  to 
focus  all  the  beams  to  one  detector.  An  investigation  into  the  feasibility  of  this  implementation  is  present¬ 
ly  being  carried  out.  In  particular,  the  effect  of  the  channel  waveguides  on  SAW  propagation  is  being  invest¬ 
igated.  Further  discussion  on  integrated-cptic,  acousto-optic  devices  is  given  in  a  paper  by  Tsai  at  this 
synpoeium. 

It  should  be  noted  that  non-optical  techniques  already  exist  to  perform  the  DFT  continuous  Fourier  trans- 
farms.  The  DFT  may  be  calculated  using  the  digital  fast  Fourier  transform  (FFT) .  An  eight-bit  10-mz  FFT 
using  parallel  architecture  has  been  announced.  A  TPC  architecture  has  been  demonstrated  using  tapped  SAW 
delay  lines.21  A  SAW  filter  implementation  of  the  chirp  transform  algorithm  (eq.  4)  has  been  demonstrated.22 
A  comparison  of  the  various  methods  for  performing  the  DPT  and  the  chirp  transform,  both  optical  and  non-opti- 
cal,  is  given  in  Table  I.  Performance  capabilities  and  the  advantages  and  disadvantages  of  each  method  are 
given. 


Time-Integrating  Processors 

The  use  of  time-integration  in  signal  processors  has  attracted  much  recent  attention  as  a  method  for  handl¬ 
ing  very  large  time-bandwidth  signals  such  as  spread-spectrum  signals ,  vrtiich  may  be  of  extremely  long  duration 
(e.g.,  days) .  This  method  overcomes  the  limit  on  T-b  product  in  space- integrating  processors  due  to  finite 
aperture,  since  it  is  possible,  using  present-day  photodetector  arrays,  to  integrate  for  times  much  longer 
than  delay  times  in  any  acoustic  celi.  It  is,  however,  natural  to  expect  acousto-optic  techniques  to  lend 
themselves  as  easily  and  advantageously  to  time- integrating  processors  as  to  space-integrating  processors, 
since  for  a  moving  acoustic  signed,  time  and  space  coordinates  are  equivalent  variables,  related  simply  by 
the  acoustic  velocity.  Acousto-optic  time- integrating  architectures  have  been  demonstrated  for  correlation, 
spectral  analysis  (one-  and  two-dimensional) ,  antoiguity  function  processing,  and  two-dimensional  spatial  light 
modulation.  Also,  various  hybrid  space-  and  time-integrating  architectures  have  been  demonstrated  or  proposed. 

There  are  several  methods  of  performing  time- integrating  correlation.  Instead  of  a  space- integrated  out¬ 
put  of  a  form  such  as 

Kt)  « 

appropriate  to  the  convolver  of  Fig.  1,  one  new  wishes  to  obtain  an  output  of  the  form 
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where  v  is  the  acoustic  velocity.  The  simplest  implementation ,  by  Sprague  and  Kcliopolous,  is  to  modulate 
the  intensity  of  a  light  source  with  signal  B(t) .  The  modulated  light  illuminates  the  entire  aperture  of  an 
acousto-optic  cell  into  which  the  signal  C(t) ,  on  a  bias,  has  bean  introduced.  The  diffracted  light  is  imaged 
onto  an  integrating  detector  array.  The  detector  output  V(t)  contains  the  desired  correlation,  eq.  (9) ,  as 
well  as  a  DC  bias  tem.  Since  the  extent  of  2  is  limited  by  the  acoustic  cell  length,  one  obtains  only  a  fi¬ 
nite  portion  of  the  correlation  function.  There  is  no  requirsnent  that  coherent  light  be  used.  This  architec¬ 
ture  cannot  directly  handle  frequency-modulated  signals ■ 

A  second  implementation,  by  Montgomery,  uses  an  unmodulated  light  source  and  an  acoustic  cell  having  counter- 
propagating  signals  B(t)  cos  upt  and  C(t)  (cos) oict. 24  The  resulting  integrated  intensity  contains  DC  bias 
terms  plus  the  correlation  integral  on  a  spatial  carrier  cos  (w^Z/v)  ,  where  wc  is  the  temporal  carrier  fre¬ 
quency  of  the  acoustic  signals.  By  having  a  spatial  carrier,  both  amplitude  and  phase  may  be  preserved. 

These  "incoherent”  processors  illustrate  several  of  the  advantages  of  time-integration.  TO  obtain  correlation, 
there  is  no  requirement  to  time-invert  one  of  the  signals,  as  in  the  space-integrating  processors.  With  an 
unmodulated  source,  the  bandwidth  is  limited  by  that  of  the  acoustic  cell.  The  ultimate  T-B  product  achievable 
is  set  by  the  dynamic  range  of  the  output  detector  array. 

Time- integrating  correlation  can  also  be  obtained  with  "coherent"  inplanentaticns,  where  the  phase  of  the 
light  is  important.  One  method  uses  coherent  light  with  detection  at  the  output  array  using  a  coherent  ref¬ 
erence  beam  as  in  an  optical  interferometer.  Light  modulation  by  the  acoustic  cell  is  1 inear  with  respect 
to  the  amplitude  rather  than  the  intensity ,  and  the  effective  bandwidth  of  the  correlation  is  increased  by  a 
factor  of  two.2'  The  correlator  by  Sprague, et  ad, in  a  coherent  implementation  produces  a  ocmplex  correlation; 
this  correlation  is  on  the  amplitude  and  phase  of  the  spatial  carrier  that  results  from  a  reference  beam  at  an 
angle  to  the  signal  beam.  It  is  also  possible  to  use  incoherent  light  to  implement  a  coherent  processor  by 
adding  a  reference  oscillator  signal  to  the  acoustic-cell  input  signals;20  this  implementation  has  the  advan¬ 
tage  of  a  potentially  simpler  optical  systan. 

A  coherent  time-integrating  correlator  using  a  SAW  delay  line  has  been  demonstrated.27  This  correlator 
features  optical  interference  between  the  Bragg-diffracted  beams  from  each  of  two  ccunterpropagating  SAW  sig¬ 
nals.  One  of  the  attractions  of  this  implementation  is  that  the  spatial  carrier  frequency  is  the  difference 
between  the  signal  frequency  and  the  center  frequency  of  the  SAW  device.  This  spatial  frequency  is  generally 
much  lower  than  the  acoustic  frequency  and  therefore  the  spatial  light  pattern  may  be  resolved  with  a  lower- 
density  photodetector  array.  Both  the  center  frequency  and  the  bandwidth  of  the  signal  may  be  obtained  from 
the  spatial  light  pattern.  T-B  products  exceeding  60  dB  have  been  achieved,  and  a  linear  dynamic  range  of 
almost  60  dB  and  a  time  aperture  of  7  us  have  been  demonstrated.  This  device  has  been  used  to  demonstrate  the 
applicability  of  time- integrating  correlators  to  the  processing  of  spread-spectrum  signals.  Both  direct-se¬ 
quence  and  frequency-hopped  signals  may  be  detected,  and  the  time-dif ference-of -arrival  of  a  signal  between 
two  separated  receiving  stations  may  be  determined  by  the  location  of  correlation  peak  on  the  detector  array. 

Bit  length  in  a  direct-sequence  code  and  hopping  characteristics  in  a  frequency  hopper  may  be  obtained  with 
appropriate  postprocessing. 

A  second  area  of  application  for  the  time- integrating  processor  is  in  ultra-high-resolution  spectral  analy¬ 
sis.  A  chirp  transform  may  be  performed  using  a  coherent  time- integrating  correlator .  An  extremely  long, 
large  bandwidth  chirp  would  theoretically  result  in  high  resolution.  However,  such  a  chirp  is  neither  prac¬ 
ticed.  nor  desirable.  There  is  a  limit  to  the  bandwidth  of  the  acoustic  device,  and  since  the  detector  array 
has  limited  size  and  element  resolution,  only  a  very  limited  frequency  span  would  be  displayed.  To  minimize 
the  bandwidth  requirement,  it  is  desirable  to  have  a  anall  chirp  bandwidth  and  to  have  the  chirp  repeated  over 
the  duration  of  the  detector  integration  period  or  the  duration  of  the  input  rf  signal .  A  wide  rf  range  will 
be  covered,  tut  this  one- dimensional  correlator  will  have  the  undesirable  feature  that  the  output  will  not 
be  on  a  continuous  display  but  rather  on  a  ccmb  function,  with  ocmb-element  width  determined  by  the  chirp  band¬ 
width  and  the  number  of  oomb  elements  equal  to  the  number  of  times  the  chirp  has  been  repeated.25  For  this 
reason  time- integrating  spectral  analysis  is  done  in  two  dimensional.  A  second  acoustic  cell  is  oriented 
perpendicular  to  the  first  and  is  used  to  display  all  frequencies  between  adjacent  ccmb  frequencies.  The 
output  is  displayed  in  two  dimensional  in  a  raster  pattern  approximately  orthogonal  to  the  direction  of  the 
first  acoustic  cell.28  Ultimate  frequency  resolution  is  determined  by  detector  integration  time.  For  example, 
a  30-ms  integration  time  implies  a  resolution  of  about  30  Hz. 

The  two-dimensional  spectrum  analyzer  is  actually  a  specific  realization  of  a  much  more  general  processor — 
the  four-product  processor.  Each  acoustic  cell  may  be  associated  with  two  input  signals.  Hence,  the  same 
architecture  as  for  the  two-dimensional  spectrun  analyzer  can  be  used  to  calculate  the  cross  ambiguity  func¬ 
tion  which  can  be  defined  as  T 

A(T,f)  *  f  x(t) y*(t  -  i)e”^2lT^t  dt,  (10) 

1  o 

where  the  variables  t  and  f  may  be  interpreted  as  delay  and  Doppler,  respectively.26  Calculation  of  the  am¬ 
biguity  function  constitutes  a  three-product  process.  Another  potential  application  of  the  four-product  pro¬ 
cessor  is  to  catpensate  for  Doppler  effects  which  limit  ultimate  correlation  gain  in  an  LPI  radar  system.2® 

The  second  acoustic  cell  contains  ccunterpropagating  chirps  which  cancel  Doppler  shifts  on  radar  return  sig- 
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nals.  The  correlation  peak  location  also  determines  the  amount  of  Doppler  shift. 


Seme  mention  should  be  made  of  hybrid  space-  and  time- integrating  processors.  The  simplest  is  the  acousto¬ 
optic  space- integrating  spectrun  analyzer  whose  output  falls  on  an  integrating  photodetector  array. 25  By 
using  low-noise  detectors,  it  is  possible  to  obtain  an  increase  in  sensitivity  with  time- integration  by  a 
factor  ,St,  where  B  is  the  signal  bandwidth  at  a  given  detector  and  T  the  det«rtor  integration  time.  Other 
hybrid  systems  that  have  been  proposed  include  the  use  of  a  space- integrating  spectrum  analyzer  in  conjunction 
with  a  fixed  photographic  reference  mask  for  correlation  of  frequency-hopped  spread-spectnm  signals.30 

TV.  Surrcnarv 


Acousto-optic  techniques  have  been  applied  to  an  ever-increasing  variety  of  signal -processing  tasks.  This 
has  occurred  in  spite  of  the  fact  that  we  may  be  reaching  ultimate  limits  in  the  performance  of  acousto-optic 
deflectors.  Improved  performance  in  acousto-optic  pn  :essors  has  been  obtained  in  a  number  of  way's. 
Architectures  such  as  the  chirp-transform  algorithm  in  acousto-optic  implementations  can  overcome  limits  on 
detector  read-out  time  that  occur  with  Bragg-cell  spectnm  analyzers,  while  maintaining  advantages  such  as 
large  bandwidth  and  large  linear  dynamic  range.  Acousto-optic  time- integrating  processors  provide  time-band- 
width  products,  or  spectral  resolution,  well  in  excess  of  the  time-bandwidth  product  of  the  acoustic  device. 
In  addition  to  spectral  analysis,  acousto-optic  processors  are  being  applied  to  tasks  such  as  ambiguity  func¬ 
tion  procsssing,  spread-spectrum  signal  processing,  and  twg-dimensional  spatial  light  modulation. 

References: 

1.  A.  Korpel,  "Acousto-Optics",  Appl.  Solid  State  Science,  71-180  (1972). 

2.  D.  L.  Hecht,  Proc.  IEEE  Ultrasonics  Symp.  (1977) ,  77  CH  1264-1SU,  p.  721. 

3.  J.  N.  Lee,  N.  J.  Berg,  B.  J.  lidelson,  Proc.  Ietf.  ultrasonics  (1977),  77  CH  1264-1SU,  p.  451. 

4.  N.  Uchida  and  N.  Niizek,  Proc.  IEEE,  61,  1073  (1973) . 

5.  A.  Korpel,  R.  Adler,  P.  Desmares,  and  W.  Watson,  Proc.  IEEE,  5£  (1966) ,  1429. 

6.  C.  S.  Tsai,  L.  T.  Nguyen,  S.  K.  Yao,  and  M.  A.  Alhaider,  Appl.  Phys.  Lett.,  26  (1975) ,  140. 

7.  J.  P.  Lee,  "Signal  Analysis  Using  the  Acousto-Optic  Spectrum  Analyzer",  Defense  Research  Establishment 
Ottawa,  Technical  Note  (Oct.  1979) . 

8.  I.  Deyhimy,  R.  C.  Eden,  R.  J.  Anderson,  and  J.  S.  Harris,  Jr.,  Appl.  Phys.  Lett.,  36^  (1980),  151. 

9.  Litton  Amecon,  Inc.,  private  oanmmication. 

10.  D.  L.  Hecht,  IEEE  Trans,  on  Sanies  and  Ultrasonics,  SU-24  (1977) ,  7.  interned 

11.  E.  B.  Felstead,  IEEE  Trans,  on  Aerospace  and  Electronic  Systems,  AES-3,  907-914  (1967) . 

12.  N.  J.  Berg,  B.  J.  Udelson,  J.  N.  Lee,  and  E.  Katzen,  Appl.  Phys.  Lett,  32  (1978) ,  85. 

13.  R.  A.  Sprague,  Opt.  Eng.,  16,  467  (1977). 

14.  M.  I.  Skolnick,  Introduction  to  Radar  Systems,  McGraw-Hill,  New  York  (1962),  Ch.  9. 

15.  N.  J.  Berg,  B.  J.  Udelson,  and  J.  N.  Lee,  Appl.  Phys.  Lett,  31^  (1977) ,  555. 

16.  J.  N.  Lee,  N.  J.  Berg,  and  P.  S.  Brody,  Proc.  tfftt  Ultrasonics  Synp.  (1979),  79  CH  1482-9,  p.  81. 

17.  L.  Hertz,  Transformations  in  Optics,  John  Wiley  &  Sons,  New  York  (1965) . 

18.  N.  J.  Berg,  J.  N.  Lee,  M.  W.  Casseday,  and  E.  Katzen,  Appl.  Phys.  Lett.,  34  (1979),  125. 

19.  J.  M.  Speiser  and  H.  J.  Whitehouse,  NUC7IN  1355R,  Naval  Ocean  Systems  Center. 

20.  Probe  Systems,  Inc.,  private  acmnunicatian. 

21.  T.  M.  Reeder  and  J.  L.  Swindell,  Tech.  Report  EOCM-73-0194-F  (Nov.  1974)  . 

22.  H.  M.  Gerard,  P.  S.  Yao,  and  0.  W.  Otto,  Proc.  IEEE  Ultrasonics  Synp.  (1977) ,  77  CH  1264-1SU,  p.  947 

23.  R.  A.  Sprague  and  C.  L.  Kolippolous ,  Appl.  Opt.,  15  (1976) ,  89. 

24.  R.  M.  Montgomery,  U.  S.  Patent  No.  3,634,749  (1972). 

25.  T.  M.  Turpin,  Proc.  of  SPIE,  154  (1978),  196. 

26.  P.  Kellman,  Proc.  of  SPIE,  2lTTl979)  ,  63. 

27.  N.  J.  Berg,  I.  J.  Abramovitz,  J.  N.  Lee,  and  M.  W.  Casseday,  Appl.  Phys.  Lett.,  36  (1980),  256. 

28.  C.  E.  Thanas,  topi.  0ptiC6,  5  (1966),  1782. 

29.  N.  J.  Berg,  I.  J.  Abranovitz,  J.  N.  Lee  and  M.  W.  Casseday,  Acousto-Optic  Time  Integrating  Correlator  for 
Detection  and  Characterization  of  Broad  Band  LPI  Carmuni cations,  to  be  published  in  Proc.  1980  Army 
Science  Conference. 

30.  D.  Psaltis  and  D.  Casasent,  Appl.  Optics,  18  (1979) ,  3203. 


m 


Function 

Technologies 

Characteristics 

Applications 

Advantage 

Disadvantage 

Bragg  coll 

Bulk  wave  and 
surface  wave 
acousto-optic  (a/o) 
integrated -optic 
spectrum  analyzer 

1-GHz  bandwidth. 

1 -MHz  resolution. 
SO-dB  dynamic  range 

Spectrum 
analysis, 
cw  excision 

_ 

100-percent 

coverage 

Relatively 
slow  readout 

Chirp 

Irani  torni 
microscan 

Surface  acoustic 
wave  (SAW)  reflec¬ 
tive  array  com¬ 
pressor, 
a/o  convolver 

|^-100-MHz  bandwidth. 

J  SO-kHz  resolution, 
j  5-bit  accuracy. 

L  65-dB  dynamic  range 

Spectrum 
analysis, 
cw  excision 

High-resolution, 
rapid  processing 

Complex 

Time  integrating 
a/o  correlator 

C  1-MHz  bandwidth. 

}  l-Hz  resolution. 

\  3-blt  Kcuracy. 

L  45-dB  dynamic  range 

Spectrum 

analysis 

Ultra-high 

resolution 

Limited 

dynamic  range 

Oiscroto 

Fourier 

transform 

Digital  fast 

Fourier  frequency 

Hybrid  SAW 

C  256-kilo  point. 

<  10-MHz  bandwidth. 

L  8-bit  Kcuracy 

C  10-Megabit/s. 

<  8-bit  accurKy. 

V.  45-dB  dynamic  range 

'  Spectrum 
analysis, 
cw  excision, 
complex 
.  arithmetic 

High  accuracy 

Large  bandwidth 

Limited 

bandwidth 

Complex 

Triple-product 
convolver 
(a/o  convolver) 

f  1-MHz  bandwidth. 

<  8-bit  accuracy, 
k.  60-dB  dynamic  range 

'  Spectrum 
analysis 
cw  excision, 
complex 
arithmetic 
and  beam 
forming 

Large  bandwidth 
high  data 
throughput 

Complex 

Table  1.  Fourier  Transform  Techniques 
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Discussion  (John  N.  Lee;  Discussion  Leader:  Harper  Whicehouse) 

q.  In  your  discussion  about  the  detector  plane,  you  talked  about  GaAs.  Why  GaAs  Instead  of  silicon,  which 
we  already  have  the  technology  for? 

A.  High  mobility.  The  speed  at  which  you  can  shift  out  information  from  a  shift  register  depends  on  how 
fast  you  can  move  charge  packets  from  one  element  to  the  next.  GaAs,  with  Its  high  mobility,  is  the  best 
material  right  now. 

Q.  In  your  discussion  of  the  acousto-photorefractlve  effect,  you  postulated  having  some  external  photo 
emission  in  order  to  record  charge  packets  in  the  array  correlator.  That’s  a  little  disturbing  because 

L  NbO.  has  a  pretty  wide  bandgap,  about  3.5  or  4  ev.,  and  a  work  function  of  3.5  or  4  ev.,  so  that's  a  four 
pnotofl  process  to  actually  emit  something.  I'm  wondering  if  that's  a  standing  acoustic  wave. 

A.  Yes,  it  is. 

R.  But  even  then  the  YAG  laser  is  taking  a  20  nanosecond  shot,  so  I  wonder  if  that's  not  Just  the  transverse 
surface  acoustic  field  driving  the  standard  kind  of  diffusion  drift  photo-refractive  effect  temporarily 
during  the  20  nanosecond  onset  of  the  laser,  and  not  an  external  photoemission.  The  surface  charge  of  the 
L.XbO,  substrate  should  change  astronomically  during  the  photoeaission  process,  so  all  you  have  to  do  to  test 
the  hypothesis  Is  to  measure  the  surface  voltage  and  see  if  it  actually  changes. 

A.  The  reason  we  came  to  the  conclusion  that  it  was  possibly  photoemisalon  was  that,  even  without  the  SAW 
present,  when  you  illuminate  the  device  with  the  laser,  it  turns  positive.  The  surface  has  a  positive  charge 
pattern  on  it  corresponding  to  the  laser  beam,  and  this  occurs  on  both  sides  of  the  crystal.  It  doesn't  look 
like  it  is  simple  charge  transport  because  we  can't  find  a  correspondingly  negatively  charged  region  for 
every  positively  charged  region,  in  fact  there  are  no  negatively  charged  regions. 

Q.  Could  you  comment  on  the  relative  merits  of  using  bulk  crystal  devices  vs.  thin  film  devices? 

A.  Bulk  wave  devices  have  been  around  a  lot  longer  and  generally  they  can  operate  at  higher  frequencies 

because  of  the  way  transducers  are  made.  They  are  thin  film  transducers,  and  you  can  go  to  higher  frequencies 
by  making  them  thinner.  The  limitation  on  the  SAW  is  bow  fine  you  can  make  the  finger  pattern.  Tou  have 

interdlgital  transducers  in  the  SAW  case,  and  eventually  you  can’t  make  the  lines  fine  enough  and  good  enough 

so  that  you  can  get  a  good  transducer.  That  limits  you  generally  to  about  1  GHz  center  frequency  whereas 
the  LjNbO-  bulk  wave  lines  can  go  up  to  about  2.5  GHz.  They're  working  directly  in  L-band  right  now.  How¬ 
ever,  with  the  planar  technology  of  SAWs  you  can  do  a  lot  of  nice  things,  like  suppress  triple  transit,  get 
flat  bandwldths,  do  phase-matching,  get  uniphase  wavefronts.  These  are  some  things  that  are  different  about 
the  two. 

Q.  Can  you  elaborate  on  that?  It  seems  that  lithography  has  been  making  great  strides.  People  claim 
chat  with  E-Beam  technology  and  X-ray  lithography,  they  can  make  very  fine  lines.  Do  you  see  this  problem 
with  defining  transducers  as  an  ultimate  limitation?  Or  is  it  a  temporary  problem  that  will  be  resolved  with 
more  work? 

A.  To  a  certain  extent,  it  is  temporary.  We  have  not  done  any  E-bean  lithography,  but  it  should  be  pos¬ 
sible.  One  problem  you  have  to  watch  for  is  that  of  matching  the  impedance  of  the  transducer  to  your  source. 
When  you  start  changing  dimensions,  you  have  to  watch  how  the  Impedance  changes,  and  you  have  to  be  able  to 
match  out  the  Interfinger  capacitances  properly  in  order  to  get  the  lowest  Insertion  loss.  I've  seen  ap¬ 
proaches  where  people  used  bulk  wave  transducers  for  their  RF  input  and  they  bounce  the  bulk  wave  up  against 
a  gracing  to  convert  it  into  surface  waves  simply  because  they  can  make  the  grating  much  better  than  they  can 
make  a  true  transducer. 

R.  I  think  you're  right  that  progress  made  with  X-ray  and  E-beam  technology  would  enable  us  to  fabricate 
SAW  transducers  with  sub-micron  dimensions,  which  would  mean  center  frequencies  of  4  to  5  GHz.  But  at  this 
time  there  is  no  need  to  push  it  further,  because  attenuation  losses  are  too  high  for  higher  frequencies.  If 
we  find  low  acoustic  loss  materials  for  SAW  or  bulk  waves,  then  there  will  be  a  need  for  fabricating  transdu¬ 
cers  at  higher  frequencies,  and  we  are  confident  that  by  that  time  progress  made  in  E-beam  and  X-ray  litho¬ 
graphy  will  enable  us  to  do  the  fabrication. 

Q.  You  gave  a  good  summary  of  the  state  of  acousto-optics.  What  do  you  think  are  the  Important  areas  that 
we  should  be  addressing  in  order  to  bring  these  devices  to  fruition? 

A.  I  would  say  the  post-processing.  The  detectors  need  improvement,  and  you  need  to  find  a  way  to  improve 
the  processing  speed,  that  is  what  holds  up  the  whole  works. 

Q.  In  a  coherent  processor,  for  example  a  spectrum  analyzer  where  you  are  trying  to  determine  magnitude 
and  phase,  your  detector  elements  must  be  packed  together  a  good  deal  closer  than  in  an  Incoherent  processor. 
How  much  of  a  penalty  do  you  pay  there? 

A.  As  you  go  farther  off  the  center  frequency  on  our  device  the  fringe  pattern  gets  finer.  Eventually  you 
are  putcing  two  fringes  onto  one  detector  element,  and  then  you  lose  any  hope  of  getting  information  out. 


With  detector  elements  13  microns  across,  25  micron  center-to-center  spacing,  and  1  to  1  imaging  of  the  a- 
coustic  cell  onto  the  detector  array,  you  get  a  64  !3tz  frequency  span.  However,  if  you  are  willing  to  toler¬ 
ate  a  smaller  time  window,  you  can  expand  the  beam,  or  conversely  you  can  make  a  longer  array. 

Q.  If  you  are  looking  for  just  magnitude,  what  sort  of  bandwidth  would  the  processor  have,  all  other  things 
being  the  same? 

A.  1  would  say  it  is  the  bandwidth  of  your  acoustic  cell,  so  you  could  be  paying  quite  a  penalty  in  order 
to  get  phase  information. 
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I.  Introduction-Guided  Have  and  Integrated  Optics  Technology 

Integrated  Optics  is  an  emerging  technology  that  has  been  actively  pursued  in  recent  year.  The  ultimate 
objective  of  integrated  optics  is  to  realize  miniature  optical  components  such  as  light  sources,  modulators, 
switches,  deflectors,  lenses,  prisms,  and  detectors  in  a  substrate  to  perform  various  useful  functions. 

Like  the  existing  integrated  electronics  in  which  a  large  number  of  active  and  passive  ocnponents  such  as 
transistors,  diodes,  resistors  and  capacitors  are  packed  in  a  small  area  semiconductor  chip,  the  integrated 
optics,  when  fully  developed,  are  expected  to  have  many  advantages  over  the  existing  bulk  optical  systems. 

Seme  of  the  advantages  of  the  miniature  oonponents  over  their  bulk  counterparts  are  mailer  size  and  lighter 
weight,  wider  bandwidth,  lesser  electrical  drive  power  requirement,  greater  signal  accessibility  and  inte- 
gratability.  The  miniature  ocnponents  are  also  expected  bo  possess  advantages  in  stability,  reliability, 
ruggedness  and  ultimate  cost. 

It  has  now  been  well  recognized  that  the  most  immediate  and  important  applications  of  integrated  optics 
lie  in  the  areas  of  wideband  nultichannel  communications  (for  both  military  and  civilian)  and  signal  pro¬ 
cessings  (far  military  hardwares  such  as  radars) .  With  regard  to  ocntunicaticns,  a  number  of  firstgeneration 
low  data  rate  laboratory  and  field  test  systons  have  been  built  and  their  performance  have  danonstrated  their 
potential.  With  regard  to  signal  processings,  research  and  development  activities  have  increased  consider¬ 
ably  as  a  result  of  recent  progress  in  guided-wave  acoustooptics.  (1,2)  For  example,  a  number  of  military  and 
civilian  laboratories  are  currently  using  wideband  planar  aooustooptic  deflectors  to  develop  an  integrated 
optic  spectrum  analyzer  for  data  processing  of  very  wideband  radio  frequency  signals  (3.4).  In  addition,  recent 
progress  on  guided-wave  electrooptic  devices  including  analog  to  digital  converters,  (5-7)  directional  coupler 
switches  (8) ,  total  internal  reflection  (TED  switches  (2,  10)  and  networks  (10-12),  and  bistable  switches 
(13)  is  a  welcome  news  bo  optical  information  processing  community. 

In  this  paper  a  brief  review  of  the  most  recent  progress  on  planar  waveguide  aooustooptics,  channel 
waveguide  aooustooptics,  and  channel  waveguide  TIR  switching  network  is  made.  Some  related  topics  for  future 
research  are  also  included. 


II.  Planar  Waveguide  Acoustooptics 
A.  Wideband  Braqc;  Modulators  and  Deflectors 

The  basic  configuration  of  planar  waveguide  aooustooptic  (AO)  Bragg  modulators  and  deflectors  is  shown  in 
Fig.  1.  The  deflection  angle  and  the  intensity  of  the  Bragg  diffracted  light  are,  respectively,  proportional 
to  the  frequency  and  the  power  of  the  HF  or  the  acoustic  signal  applied  to  the  surface  acoustic  wave  (SAIT) 
transducer.  It  is  now  possible  to  design  and  fabricate  high-performance  planar  aooustooptic  (AO)  Bragg 
nodulators  and  deflectors  with  a  bandwidth  approaching  one  GHz, (2) -  F or  example,  the  deflectors  of  700  and 
470  MHz  bandwidth  have  been  realized  most  recently  in  Y-cut  LiNb03  waveguides  using  multiple  tilted  trans¬ 
ducers  'am1!'  tilted-finger  chirp  transducer, 5 '^respectively  With  same  improvement  in  transduction  efficiency 
of  the  SAW  transducers  an  ultimate  diffraction  efficiency  of  about  50%  at  one  watt  RF  drive  power  for  one 
GHz  bandwidth  can  be  expected 5 2 'The  measured  efficiency  of  the  700  .'Hz  and  470  MHz  bandwidth  deflectors 
referred  to  above  are  10%  at  orve  watt  RF  drive  power  and  16%  at  0.2  watt  FF  drive  power,  respectively. 
Finally,  an  ultimate  time-bandwidth  product  (defined  as  the  product  of  the  acoustic  transit  time  across  the 
incident  light  beam  aperture  and  the  modulator/deflector  bandwidth)  of  up  of  4000  may  be  achievable  (2) . 

B.  Integrated  Acoustooptical  Circuits.  Integrated  AO  circuits  require  integration  of  all  active  and 
passive  optical  components  on  a  single  substrate  or  a  snail  nunber  of  substrates.  Using  an  RF  spectrum 
analyzer  as  an  exasple,  a  fully-integrated  or  monolithic  AO  circuit  is  depicted  in  Fig.  2.  The  AlGaAs 
multilayer  structure  is  a  potential  substrate  for  this  monolithic  module.  In  this  case  the  light  source 
takes  the  convenient  form  of  a  distributed  feedback  or  Bragg  reflector  laser.  However,  most  of  the  other 
passive  and  active  caiponer.ts  for  this  monolithic  module  retain  to  be  developed.  At  present,  silicon 
(thermally  oxidized)  and  lithium  niobate  are  the  two  most  promising  substrates  for  inp lamentation  of  a 
hybrid  module(3)Jn  the  former  the  light  source  such  as  a  GaAlAs  DK  laser  diode  is  butt-coupled  (17) 
to  one  edge  of  the  Si  substrate.  In  the  latter  both  the  GaAlAs  DH  laser  diode  and  the  photodetector  array 
are  butt-coupled  to  the  edges  of  the  LiHb03  substrate  (see  Fig.  3) .  The  wideband  AO  nodulator/def lector 
together  with  recent  progress  on  fabrication  of  miniature  laser  sources,  waveguide  geodesic  lenses,  and 
photodetector  arrays,  integration  of  all  or  most  of  these  components  on  a  canton  substrate  is  becoming  a 
reality. 

A  model  design  has  shown  that  a  Y-cut  LiNbOj  plate  having  a  substrate  area  of  2.5x8  cm  is  sufficient  to 
accommodate  all  passive  and  active  components.  In  view  of  the  fact  that  high-quality  optical  waveguides, 
geodesic  lenses,  and  wideband  high-efficiency  Bragg  deflectors/modulators  have  been  successfully  fabricated 
in  the  LlNhT>3  substrate,  the  hybrid  structure  as  shown  in  Fig. 3  appears  to  be  the  most  attractive  approach 


*This  work  was  supported  by  the  AFOSR,  AROD,  NSF,  and  HOATC. 
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for  the  present.  Implementation  of  this  hybrid  AS  circuits  is  being  carried  out  at  a  number  of  research 
laboratories  in  the  United  States. 

C.  Sane  Potential  Applications ■  Clearly,  the  resulting  integrated  AD  modules  or  circuits  should  find  a 
n unoer  of  unique  applications  in  wideband  multichannel  optical  ccmnunications  and  KF  signal  processing .  As 
indicated  earlier,  one  application  that  has  already  received  a  great  deal  of  attention  and  interest  is  real¬ 
time  spectral  analysis  of  wideband  rf  signals.  Other  applications,  such  as  correlation,  convolution,  pulse 
oonpression  and  natched  filtering  of  rf  signals,  and  multiport  switching  of  optical  signals  in  a  single-node 
fiber  optic  oamunication  system,  (2)  should  not  be  far  behind. 

One  of  the  most  important  classes  of  optical  signal  processors  is  based  on  the  use  of  coherent  acoustooptic 
interactions.  A  number  of  bulk-type  AO  signal  processors  have  been  studied  and  demonstrated.  (18)  Most  of 
these  bilk-type  and  quasi  bulk-type  AO  processors  for  one-dimensional  signal  processing  may  be  implemented 
using  the  planar  guided-wave  structure.  In  fact,  sane  encouraging  results  have  already  been  dononstrated  in 
the  experiments  on  spectral  analysis,  (1,2)  convolution,  (1,2)  pulse  ccnpressian,  (19)  and  time-integrating 
correlations  (20) .  Better  results  can  be  expected  using  the  integrated  AO  circuits.  (21)  In  this  subsection 
two  of  the  most  premising  applications,  namely,  spectral  analysis  and  time-integrating  correlation  are  decribed. 

1.  Spectral  Analysis  of  Very  Wideband  KF  Signals.  As  mentioned  in  the  Introduction,  inplsnentation  of 
an  RF  spectrum  analyzer  using  monolithic  or  hybrid  integrated  optic  technique  has  already  received  a  great 
deal  of  attention  and  interest  in  both  military  and  civilian  communities.  Fig.  2  depicts  a  schematic 
diagram  of  a  monolithic  integrated  optic  spectrum  analyzer.  When  a  spectrum  of  rf  signals  are  applied  to  the 
transducer,  each  spectral  oanponent  generates  a  SAW  which  deflects  the  incident  light  beam  in  a  corresponding 
direction.  As  indicated  previously,  the  deflection  angle  and  the  intensity  of  the  Bragg  diffracted  light  are, 
respectively,  proportional  to  the  frequency  and  the  power  of  the  RF  or  the  acoustic  signal.  Thus,  by  measur¬ 
ing  the  linear  positions  and  the  intensities  of  the  deflected  (diffracted)  light  spots  at  the  focal  plane 

of  the  transform  lens  the  power  spectral  density  of  the  rf  signal  at  interest  may  be  determined.  In  an 
actual  spectrum  analyzer,  the  Bragg  diffracted  light  beams  are  focused  on  a  photodetector  array  and  the 
rf  spectra  is  read  out  using  a  CCD  array.  The  number  of  resolvable  channels  and  the  corresponding  frequency 
resolution  are  given  in  Ref.  2.  For  the  680  mz  bandwidth  deflector  which  we  have  fabricated  most  recently 
in  a  Y-cut  LiNb03  waveguide,  (IS)  the  measured  frequency  resolution  is  0.6  MHz  for  a  truncated  Gaussian  light 
beam  of  6  ran  aperture.  Thus,  based  on  the  measured  resolution  this  deflector  would  provide  1130  resolvable 
frequency  channels.  This  deflector  has  also  provided  the  deflected  and  undeflected  light  spots  of  very 
fine  quality. 

The  integrated  optic  RF  spectrum  analyzers,  when  fully  developed,  are  expected  to  possess  two  major  advan¬ 
tages:  1.  increased  performance  and  reduced  cost  over  both  currently  employed  technology  and  carpeting  tech¬ 
nologies,  and  2.  reduced  size  and  increased  ccnpactness. 

2.  Time-Integrating  Correlation  of  Wideband  RF  Signals.  Acoustooptic  time-integrating  correlators 
(AOTIC)  perform  correlation  by  using  a  closely  spaced  photodetector  array  to  integrate  in  time  for  each  point 
within  the  Bragg  cell.  (22,23)  A  fully-integrated  or  monolithic  guided-wave  version  (2)  is  depicted  in  Fig. 

4.  The  signal  to  be  correlated,  $i(t) ,  is  added  with  a  bias  voltabe  V1  and  used  to  modulate  the  intensity  of 
a  wave-guide  laser  source.  The  modulated  light  is  then  collimated  and  diffracted  by  the  surface  acoustic 
wave  produced  by  an  RF  carrier  which  is  anplitude-modulated  by  the  reference  signal  S2  (t) .  A  proper  choice 
of  bias  voltage  Vj  would  ensure  that  the  intensity  of  the  diffracted  li^it  is  linearly  proportional  to  S-  (t) 

The  diffracted  light  is  then  collected  by  a  waveguide  lens,  filtered,  and  imaged  onto  a  photodetector  array. 

It  can  be  shewn  that,  if  Sj(t)  and  Sjtt)  have  zero  means  values,  the  intensity  of  the  diffracted  light  at 
the  output  of  the  photodetector  array  contains  the  correlation  signal  between  Si (t)  and  S2 (t) .  This  correl¬ 
ation  signal  is  displayed  in  space  but  can  be  read  cut  in  time  using  a  OCX)  array.  Since  the  correlation  is 
performed  in  time  rather  than  in  space  this  type  of  correlator  is  potentially  capable  of  a  very  long  process¬ 
ing  time  which  is  determined  by  the  time  constant  of  the  photodetector  array.  Furthermore,  since  both  the 
coherent  light  aource  and  the  AO  Bragg  cell  can  be  modulated  at  GHz  bandwidth,  this  type  of  correlator  is 
also  potentially  capable  of  very  large  bandwidth,  and  thus  very  large  time-bandwidth  product.  Our  preliminary 
experiments  using  surface  acoustic  waves  (centered  at  125  ttlz)  in  a  Y-cut  LiNb03  waveguide  and  a  He-Ne  laser 
light  (6328  A)  have  demonstrated  a  processing  time  of  7  milliseconds  and  a  time-bandwidth  product  of  1.5  x  10s 
(20). 

As  in  the  spectrum  analyzers,  although  the  AlGaAs  multilayer  structure  is  the  ideal  substrate  for  the 
monotithic  AOTIC  modules  the  hybrid  structure  using  a  LiNbOs  substrate,  as  illustrated  in  Fig.  5  constitutes 
the  most  attractive  and  realizable  approach  for  the  present.  A  model  design  has  shown  that  a  Y-cut  LiNb03 
plate  having  a  substrate  area  of  2.5  x  6  an  is  sufficient  to  accomodate  all  passive  and  active  covenants. 
Based  on  the  aforementioned  preliminary  results,  (21) this  hybrid  AOTIC  should  be  capable  of  providing  nut* 
better  performance  figures  (21) . 


As  indicated  in  Section  XI,  planar  AO  interactions  and  devices  have  already  been  shown  highly  useful  for 
wideband  multichannel  integrated  optic  ccranunicaticn  and  signal  processing  systems.  (2)  On  the  other  hand 
acoustooptic  Bragg  deflection  in  channel  waveguides  in  which  the  optical  waves  are  confined  in  the  channels 
has  received  nut*  less  attention  heretofore.  Nevertheless,  the  resulting  channel  devices  are  potentially 
more  useful  in  fiber  optic  systems  because  of  the  compatibility  in  dimension  and,  thus,  the  relative  simpli¬ 
city  in  facilitating  the  coupling  between  the  channel  waveguide  and  the  optical  fiber. 

One  interaction  configuration  of  great  interest  is  shown  in  Fig.  6.  Two  identical  channel  waveguides 
are  crossed  at  an  angle  y.  One  unique  characteristic  of  these  crossed  guides  is  that  the  refractive  index 
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change  in  the  cross-over  (intersection!  region  is  twice  that  in  the  channel.  As  a  result,  the  crosstalk 
between  the  two  guides  can  be  reads  snail.  (10,24)  An  interdigital  transducer  is  symmetrically  positioned 
so  that  the  SAW  generated  propagates  in  the  intersection  region.  The  center  frequency  of  the  SAW  is  such 
that  the  corresponding  Bragg  angle  is  equal  to  one  half  of  the  intersection  angle.  An  optical  wave  incident 
at  guide  1  is  Bragg  diffracted  by  the  nerving  optical  grating  induced  by  the  SAW.  Consequently,  a  portion  of 
the  incident  light  is  deflected  to  guide  2.  The  frequency  of  the  deflected  light  is  up-shifted  by  an 
amount  equals  to  the  acoustic  frequency.  Similarly,  an  optical  wove  incident  at  guide  2  will  have  portion 
of  its  intensity  deflected  to  guide  1  and  have  the  frequency  of  the  deflected  light  down-shifted  by  the 
same  amount.  Such  a  device  configuration  will  have  a  variety  of  unique  applications  in  future  integrated 
and  fiber  optic  systems  such  as  double-pole-double-throw  switching,  time-division  multiplexing,  and  darultip- 
lexing,  and  heterodyne  detection.  In  the  last  application  the  frequency-shifted  light  can  be  conveniently 
used  as  a  reference  signal  (local  oscillator)  in  connection  with  optical  oomnunicationa  and  fiber  optic  sensing. 

We  have  recently  demonstrated  encouraging  results  with  the  device  configuration  just  described  in  a  Y-cut 
LiNbC>3  substrate.  (25)  The  center  frequency  of  the  SAW  is  634  tKz,  appropriate  for  the  3.0©  intersection 
angle  between  guide  1  and  guide  4.  Ten  finger  pairs  of  0.77  ntn  aperture  are  used  in  the  transducer.  A 
diffraction  efficiency  of  up  to  67%  has  been  obtained  using  an  rf  power  of  800  raw.  Since  the  measured  con¬ 
version  efficiency  of  the  transducer  is  -12  db  and  a  conversion  efficiency  of  -6  db  had  been  routinely 
demonstrated  with  this  type  of  transducer  in  this  laboratory,  it  should  be  possible  to  reduce  this  drive 
power  by  a  factor  of  4.  A  -3  db  deflector  bandwidth  of  71  MHz  has  been  measured.  Finally,  when  acting 
as  an  optical  switch  a  switching  time  (defined  as  the  time  between  0  and  100%  points)  of  25  nanoseconds  has 
been  measured.  (25) 

Networks  and  Matrices  Using  TTR  Switches 


A.  Inproved  Optical  Channel  Waveguide  TIR  Switch. 

Me  have  recently  demonstrated  acme  superior  features  of  an  inproved  version  of  the  TIR  switch  (10)  which 
does  not  require  any  horn  section  (Fig.  7) .  This  switch  enploys  straight  2An  intersections  in  a  Y-cut  LiNbOj 
substrate.  As  indicated  previously  in  Section  III,  the  crosstalk  of  this  type  of  intersections  can  be  made 


The  2 An  intersections  of  various  intersecting  angle  ?  were  first  fanned  in  a  Y-cut  LiNb03  substrate  by  the 
now  well-established  Ti-dif fusion  method.  The  width  of  each  channel  waveguide  is  typically  20  uci.  A 
pair  of  parallel  metal  electrodes  having  5  un  in  separation  and  typically  1.6  ms  in  length  was  than  deposited 
at  the  center  of  the  intersection  region.  Switching  and  modulation  experiments  were  carried  out  using  s 
6328  A  He-Ne  Laser  Light  propagating  in  the  TE  fundamental  mode.  Performance  figures  considerably  better 
than  that  obtained  with  the  device  with  horn  sections  (9)  have  been  measured.  (10)  For  exanple,  the  drive 
voltages  of  only  5,  8,  and  11  volts  are,  respectively,  required  for  maxisun  switching  in  the  switches  with 

I. 0°,  1.5°,  and  2.0©  intersections.  Fig.  8  shows  the  modulation  curves  far  the  switch  with  the  intersection 
angle  of  1.0©.  The  corresponding  switching  efficiency  in  light  power  are  93,  88,  and  92%.  The  corresponding 
crosstalks  or  extinction  ratio  which  is  defined  as  the  ratio  of  the  switched  (reflected)  light  power  and  the 
unswitched  (transmitted)  light  pewsr  in  db  are  measured  to  be  15.7,  17.5,  and  17.0  db.  The  measured  inser¬ 
tion  loss  is  around  1.3  db  for  all  witches.  This  loss  is  mainly  caused  by  the  electrodes  and  should  be¬ 
come  smaller  if  a  dielectric  buffer  layer  is  added.  Thus,  it  is  reasonable  to  suggest  that  higher  switching 
efficiencies  and  snaller  crosstalks  than  those  just  mentioned  should  be  achievable  after  such  a  buffer  layer 
has  been  added  to  the  witches.  Finally,  the  calculated  capacitances  of  the  electrode  pairs  indicate  that 
the  corresponding  base  bandwidths  of  the  three  switches  with  a  50  otm  termination  should  be  5.9,  7.8,  and 

II. 8  GHz,  respectively.  In  view  of  the  low  drive  voltage  requirement  and  the  subnanoseoond  switching  speed, 
and  the  sinplicity  in  device  design/fabrication  this  improved  TTR  switch  should  find  a  variety  of  applications 
including  the  residue  arithmetics  based  optical  canputers  (26) . 

B.  4x4  Optical  Switching  Network/Matrix.  High-speed  lw-drive  power  optical  switching  networks  and 
matrices  should  perform  inparfcant  functions  in  future  integrated  and  fiber  optic  systems.  Gxaoples  range 
from  pure  optical  systems  such  as  multichannel  fiber  optic  ocmtunicaticn  termini.1  a  (27)  and  optical  omtputars 
(26)  to  hybrid  systems  such  as  electronic  computer  networks  and  oomnunicatior  buses.  An  integrated  optical 
switching  matrix  (network)  was  first  described  a  fw  years  ago,  (11)  and  a  4x4  switching  matrix  was  later 
realized  in  a  LiNkc^  substrate  (12)  using  five  stepped  as  reversal  directional-coupler  switches.  (8)  In 
view  of  the  simplicity  and  the  superior  performance  of  the  improved  TIR  switch  just  described  in  the  last 
subsection  we  have  most  recently  fabricated  a  3x3  and  a  4x4  switching  networks  consisting  of  such  switched 
in  Y-cut  LiNbC>3  substrates.  Note  that  3x3  and  4x4  switching  networks/fte  trices  are  the  basic  building  blocks 
far  large  networks/ma trices . 

A  4x4  witching  network  which  consists  of  4  straight  channel  waveguides  and  5  improved  TIR  switches  is 
sham  in  Fig.  9.  It  is  clear  that  an  optical  signal  entering  at  any  of  the  input  ports  can  be  routed  to 
any  of  the  output  ports  by  proper  combination  of  the  individual  switches  being  activated.  The  dimensions 
of  the  4x4  switch  we  have  experimented  with  are  6.18  mm  x  0.20  irm  in  which  6.18  nm  is  the  total  length  of  the 
witch.  The  width  of  each  channel  waveguide  is  20  un.  Very  encouraging  results  have  been  obtained  with  this 
preliminary  matrix  witch.  For  exanple,  Fig.  10  shows  the  waveforms  detected  at  the  four  output  ports  when 
the  light  enters  the  second  input  port  (12)  and  both  Switch  S2  and  Switch  Se  are  activated.  Note  that  the 
input  light  is  a  cw  He-Ne  laser  at  0.S328  un.  Vie  see  that  the  input  light  is  routed  to  output  port  O2  with 
very  high  efficiency  (v  95%)  and  the  crosstalks  detected  at  output  ports  O3  and  O4  are  low  (^  -17  db) . 

The  preliminary  results  just  mentioned  are  very  significant  in  view  of  the  simplicity  of  the  switching  network 
and  the  various  advantages  that  can  be  expected  fron  the  basic  TTR  switch. 
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V.  Sane  Topics  Suggested  for  Future  Research 

The  recent  progress  in  guided-wave  acoustooptic  and  electrooptic  devices  as  decribed  above  has  suggested 
a  number  of  related  topics  for  further  research.  Sane  of  these  topics  are  as  follows: 

1.  Study  of  alternate  substrate  and  AO  interaction  media:  Growth  and  characterization  of  thin-film 
materials  which  have  higher  AO  figure  of  merit  than  LiNbOj  such  as  AS2S3,  Te02  and  Te  are  worth  undertaking. 
A  higher  AO  figure  of  merit  inplies  a  lower  acoustic  pcwer  density  and,  thus,  a  lower  acoustic  nonlinearity 
and  a  higher  dynamic  range.  (2) 

2.  Search  for  better  methods  for  efficient  electrical  to  acoustical  transduction  in  conjunction  with 
silicon  and  GaAs  substrates:  Methods  which  are  simpler  and/or  more  efficient  than  the  commonly  used  ZnO 
overlayer  (28)  are  highly  desirable. 

3.  Implementation  of  one  or  several  integrated  optic  modules  or  circuits  to  identify  basic  and  inport- 
ant  problem  areas  for  in-depth  research:  The  Navy-Air  Force  program  on  integrated  optic  spectrum  analyzers 
may  serve  as  a  model  for  this  undertaking.  Integrated  optic  switching  network  or  matrix  is  one  of  the 
potential  candidates  for  this  purpose. 

4.  Identify  and  study  suitable  signal  processing  architectures  in  conjunction  with  the  integrated  AO 
circuits:  The  schemes  capable  of  multi-dimensional  time-integrating  correlations  are  of  particular  interest. 

5.  Study  of  new  opto-aooustic  and  opto-electronic  interactions:  Study  of  high-risk  but  basic  inter¬ 
actions  and  phenomenon  deserves  support.  This  type  of  basic  research  may  open  up  new  types  of  device  and 
application.  One  exanple  of  this  type  of  research  is  the  efficient  diffraction  of  submillimeter  wave 
from  free-electron  density  waves  in  piezoelectric  semiconductors  such  as  n-type  inSb  reported  recently. (28) 
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Discussion  (Chen  S.  Tsai;  Discussion  Leader:  Carl  Verber) 

q.  Is  the  ultimate  limit  on  crosstalk  in  your  switches  just  due  to  the  quality  of  your  waveguides? 

A.  We  did  some  calculations  based  on  discrete  boundaries  and  the  results  showed  that  crosstalk  should  be 

smaller  than  what  we  measured.  But  we  really  have  a  diffuse  boundary,  shaped  something  like  a  Gaussian  or 
complementary  error  function.  Analytical  calculations  remain  to  be  done  to  determine  the  opcimal  boundary 
shape.  However,  lc  may  be  that  the  best  technique  is  not  to  try  to  get  the  best  out  of  a  single  switch,  but 
to  just  add  an  additional  switch  to  beccer  the  crosstalk  by  a  factor  of  2  in  db. 

Q.  It  seems  chat  with  present  technology  we  are  very  limited  in  how  much  we  can  change  the  refractive 
index,  and  this  in  turn  seems  to  imply  that  we  will  always  measure  the  size  of  integrated  optics  devices  in 
maybe  millimeters  instead  of  microns.  This  same  problem  shows  up  with  the  electro-optic  switches  which  have 
to  come  in  almost  at  grazing  incidence  in  order  to  work  properly.  Are  we  going  to  see  improvements  in  this 
regard? 

A.  That's  a  very  important  question.  With  conventional  titanium  diffusion  methods,  developed  at  Bell  Labs 
and  other  places,  the  most  one  can  get  is  about  12  or  22.  But  a  recent  development  at  Bell  Labs  uses  an  ion 
exchange  technique  to  obtain  an  index  change  of  52  or  62,  and  thac's  a  very  encouraging  result.  With  an  in¬ 
dex  change  of  about  12,  yoi>  • ^t  an  angle  between  transmitted  and  reflected  beams  of  around  12°,  but  with  a 
62  index  change,  the  angle  ureases  to  almost  452.  This  means  the  angles  between  switch  paths  can  be  in¬ 
creased,  so  that  the  aspect  ratio  of  a  switch  array  would  be  more  like  1:1  rather  than  the  present  20:1. 

q.  You  stated  that  it  takes  a  change  of  voltage  of  5  volts  to  activate  the  electro-optic  switch.  If  the 
index  change  increases,  does  that  imply  that  the  switching  voltage  would  be  lowered? 

A.  No,  the  electro-optical  effect  isn't  changing,  so  you  still  have  to  switch  in  and  out  of  the  critical 
angle. 

C.  Total  internal  reflection  only  works  in  principle  for  plane  waves.  As  you  have  variation  across  the 
beam,  you  get  leaky  waves,  and  as  you  improve  your  angle  to  make  the  device  smaller,  the  variation  across  the 
wavefront  will  increase.  The  larger  angle  will  improve  packing  density  of  the  switches,  but  leaky  waves  will 
be  emphasized  and  thus  crosstalk  performance  will  suffer. 

R.  I  chink  it  is  possible,  but  we  haven't  examined  the  problem.  That's  why  I  say  we  have  only  scratched 
the  surface. 

q.  In  materials  with  a  greater  change  of  index,  what  is  the  ulelmace  smallest  size  for  these  switches? 

A.  This  4x4  switch  is  about  1.6  mm.  from  end  to  end,  so  the  device  itself  is  already  very  short.  The 

thing  which  requires  space  is  the  channel  separation  in  order  to  interface  with  fibers  for  input  and  output. 
This  separation  will  be  enhanced  by  using  materials  with  a  greater  change  of  index.  Bell  Labs  and  Hughes 
built  a  4  x  4  switch  using  directional  couplers,  but  they  had  to  use  tapered  guides,  and  chat  takes  a  lot  of 
space.  Here  we  are  talking  about  a  straight  waveguide  which  takes  much  less  space. 

q.  Your  switch  and  spectrum  analyzer  were  on  L  NbOj,  yet  che  material  GaAs  can  essentially  incorporate 
all  components,  and  so  can  Si,  except  possibly  the  laser.  Could  you  comment  on  future  directions  here? 

A.  Ac  this  time  only  L.NbO,  has  the  best  optical  attenuation  parameter,  and  lighc  is  very  precious  in  a 

substrate.  L  :;b0  is  the  best  in  terms  of  acousto-optic  interaction  efficiency,  transducer  efficiency,  and 
optical  attenuation.  People  have  examined  Si  substrates  with  a  special  glass  overlay,  but  it  doesn't  have 
nearly  as  good  properties  as  L  NbO^.  In  time,  maybe  progress  in  different  glasses  and  Si  substrates  will  be 
made.  With  GaAs,  che  problem  is  to  find  a  technique  to  generate  surface  acoustic  waves,  because  efficiency 
is  poor  and  acoustic  attenuation  is  high.  Bragg  diffraction  efficiency  can  be  very  good  because  the  figure 
of  meric  is  about  20  times  better  Chan  for  L^NbOj,  but  optical  attenuation  is  high,  about  4  db  per  cm.  as  op¬ 
posed  to  .5  or  1  db  for  L^NbO^.  L 

0  Could  you  trade  off  high  figure  of  merit  against  coupling  efficiency  if  you  have  your  laser  integrated 
right  on  the  chip? 

A.  I  haven't  done  chat  yet,  maybe  someone  in  Industry  has.  Although  L,MbO,  is  presently  the  best  macerial, 
chat  doesn't  mean  we  don't  do  research  in  Si  and  GaAs.  There  are  also  other  materials,  such  as  arsenic  tri- 
sulphide  which  has  a  figure  of  merit  about  70  times  greater  than  L.NbO,,  whose  optical  loss  is  high  and 
scattering  is  poor.  But  it  is  worthwhile  to  continue  studies  to  see  if  one  can  get  a  better  quality  of  film, 
and  then  we  could  utilize  the  higher  figure  of  merit.  What  is  the  consequence  of  a  higher  figure  of  merit? 

We  need  lower  acoustic  power  for  efficient  diffraction,  and  with  lower  acoustic  power  we  have  lower  acoustic 
nonlinearity.  Acoustic  nonlinearity  is  proportional  to  acoustic  oower  squared,  so  if  you  only  need  low 
acoustic  power,  perhaps  arsenic  trisulphide  could  give  you  high  efficiency  and  potentially  a  higher  dynamic 
range.  Ocher  materials,  such  as  cadmium  dioxide  and  tellurium,  which  have  higher  figures  of  merit  than 
LjNbOj,  are  also  worthwhile  alternate  substrates  to  study. 
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Abstract 


Beginning  in  1976,  a  new  approach  to  optical  data  processing  was  introduced  which  retains  many  of  the  ad¬ 
vantages  while  circumventing  many  of  the  disadvantages  of  conventional  coherent  optical  processing.  This 
approach  exploits  the  Optical  Transfer  Function  (OTF)  of  spatially  incoherent  imaging  systems.  It  requires 
mastery  of  techniques  for  controlling  OFTs;  the  field  of  OTF  synthesis  was  born!  We  develop  the  subject  by 
first  motivating  (Section  1)  and  explaining  (Section  2)  noncoherent  optical  processing,  then  delving  into 
OTF  sythesis  (Section  3),  and  end  by  reviewing  noncoherent  optical  processing  applications  and  suggesting 
directions  for  further  work  in  Section  4. 

1.  Introduction  and  Motivation  For  Noncoherent  Optical  Processing 

Speed  of  light,  diffraction  limited  parallel  processing  of  large  blocks  of  data  -  this  is  the  potential  of 
optical  signal  processing.  Many  years  of  effort  to  harness  coherent  optics  have  been,  however,  only  a  par¬ 
tial  success;  coherent  optical  processors  remain  vulnerable  to  parasitic  coherent  noise,  fussy  spatial  filter 
alignments,  problems  with  2-dimensional  spatial  light  modulators,  etc.  On  the  other  hand,  noncoherent  optical 
devices  (binoculars,  slide  projectors,  eyeglasses,  even  precision  microscopes  and  shaft  encoders)  are  rela¬ 
tively  carefree.  This  robust  character  suggests  noncoherent  optics  would  be  superior  to  coherent  optics  for 
data  processing.  In  the  next  section  we  shall  trace  light  through  both  coherent  and  noncoherent  processors, 
and  illustrate  the  following  specific  advantages  possessed  by  the  noncoherent  approach: 

a)  Noncoherent  processors  are  insensitive  to  phase  noise  at  the  input,  and  consequently  a  wider  variety 
of  input  devices  (CRTs,  self  luminous  objects,  laser  scanners)  are  accommodated.  Furthermore,  if  a 
Spatial  Light  Modulator  (SLM)  intended  for  coherent  optics  is  employed,  phase  defects  in  the  SLM  are 
inconsequential . 1 

b)  Noncoherent  processors  possess  an  inherent  multi-channel  redundancy  which  provides  a  reduction  in  sys¬ 
tem  noise  due  to  scratches  or  dust. 3 <3 

c)  Larger  dynamic  ranges  may  be  possible  in  coherent  processors,  thanks  to  the  lower  noise  floor  and  the 
linearity  of  noncoherent  processors  with  intensity  which  dovetails  with  the  linear  intensity  response 
of  many  detectors. 4 

d)  In  some  cases,  noncoherent  processors  offer  fewer  critical  mechanical  and  alignments  than  coherent 
processors. 3 

e)  Noncoherent  processing  offers  freedoms  in  filter  (OTF/pupil  mask)  design  which  have  no  analog  in  co¬ 
herent  systems.  This  freedom  permits  pupil  mask  design  choices  and  trade-offs  between  signal  to  noise 
and  space-bandwidth  product  (Section  3).»* 

f)  Noncoherent  optics  makes  feasible  larger  space- bandwidth  products  (and  processing  gains)  then  coherent 
systems. * 


2.  General  Principles 

The  Idea  of  performing  convolutions  with  a  diffraction  limited  noncoherent  optical  system  was  pioneered  by 
Lohmann7  and  Lowenthal.'  A  noncoherent  imaging  system  naturally  forms  the  convolution  of  the  input  image 
with  the  imaging  system  impulse  response  (point  spread  function).  To  convolve  two  functions,  one  must  be 
implemented  as  the  Impulse  response;  the  other  Is  entered  as  an  intensity  distribution  at  the  input  plane,  and 
the  desired  convolution  is  formed  at  the  output  plane  (Figure  1).  The  point  spread  function  ( PSF)  must  be 
shaped  into  the  desired  convolving  function  by  an  appropriate  choice  of  pupil  plane  mask.  Let  us  stress  that 
the  pupil  mask  shapes  the  PSF  by  diffraction  not  by  shadowcasting.  This  decision  permits  the  processing  of 
large  arrays  of  data,  but  it  also  requires  relatively  narrowband  illumination.  Lohmann  has  shown  that  ( VAA) 
must  be  greater  than  the  1-dlmensional  space-bandwidth  product  of  the  system.1 

A  longstanding  objection  to  this  convolving  technique  has  been  the  lack  of  "negative"  intensity;  most  ap¬ 
plications  Involve  bipolar  data  or  bipolar  convolving  functions.  One  answer  to  this  objection  is  the  en¬ 
coding  of  polarity  information  with  a  temporal  or  spatial  carrier  frequency.  The  phase  of  a  carrier  need  not 
be  restricted  to  0  or  it,  so  complex  values,  as  well  as  positive  and  negative  values,  may  be  represented. 
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2.1  Spatial  carrier  case 

To  avoid  confusion  between  the  spatial  carrier  case  and  the  temporal  carrier  case,  we  shall  cover  each 
separately.  A  phase  coded  spatial  carrier  is  generated  on  the  PSF  by  limiting  the  transmitting  area  of  the 
pupil  mask  to  a  pair  of  spatially  offset  sections  (Figure  2).  In  essence,  the  resulting  PSF  is  a  Young's 
fringe  pattern,  modulated  in  'ntensity  and  encoded  in  phase  through  one's  choice  of  pupil  mask. 

As  is  well-known,  the  PSF  convolving  technique  is  equivalently  described  as  spatial  filtering  by  the  sys¬ 
tem  OTF.  The  business  portion  of  the  OTF  is  frequency  offset  from  DC  (Figure  3),  because  the  desired  con¬ 
volving  function  has  been  represented  on  the  PSF  by  a  modulated  spatial  carrier.  In  the  output  image,  the 
processed  data  is  also  represented  as  modulation  of  a  spatial  carrier.  Bandpass  filtering  and  demodulation 
is  needed  to  Isolate  and  recover  the  processed  data  for  display  or  further  processing.  Standard  electronic 
filters  and  heterodyning  mixers  are  suited  for  this  step,  if  the  output  image  is  detected  and  scanned  out  in 
a  sequential  raster  format. 

In  mathematical  terms,  the  input  output  relationship  of  a  noncoherent  processor  is  given  by’ 

0(x)  *  I(x)  *  F(x)  ,  (1) 

where  I(x)  represents  the  input  intensity  distribution,  F(x)  represents  the  intensity  PSF,  and  0(x)  repre¬ 
sents  the  output  intensity  distribution.  We  have  Included  only  one  spatial  dimension  for  simplicity.  The 
input  illumination  is  assumed  to  be  spatially  Incoherent  and  so  each  Input  point  is  Imaged  Independently;  and 
so  the  output  Intensity  is  the  convolution  (denoted  by  *)  of  the  input  intensity  with  the  PSF.  The  equiv¬ 
alent  frequency  domain  statement  is 

0(u)  *  I(u)F(u)  ,  (2) 

where  the  tilde  represents  Fourier  transformation.  F( u)  is  the  OTF  of  the  system.  To  understand  how  the  OTF 
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Fig.  3.  Frequency  domain  viewpoint 


is  related  to  the  pupil,  we  observe  that  the  intensity 
PSF  is  given  by  the  square  magnitude  of  an  amplitude 

p(x) : 


F(x)  =  |p(x)|‘  (3) 

Fourier  transforming  this  equation  one  finds 


F(b)  *  /  p(e  +  p)  P*  (Od£  2  p(p)*p(p)  ,  (4) 


where  p(x)  and  p(u)  form  a  Fourier  transform  pair,  and 
where  ♦  represents  the  correlation  operation.  From  our 
knowledge  of  Fourier  optics,  we  recognize  that  p(u)  is 
the  pupil  function  that  yields  the  amplitude  p(x)  in 
the  output  plane.  Thus  the  OTF  is  given  by  the  auto¬ 
correlation  of  the  pupil  function.  When  the  overall 
pupil  consists  of  two  spatially  offset  pupils  Pi(u)  and 
Mb) 


p( u)  *  Pi(b)  +  Pz(u-A)  ,  (5) 

the  OTF  consists  of  an  interaction  part 

(Mb)  *  p2( y-A)  +  Mb-A)  *  Mb)) 
and  a  noninteraction  part 


(Mb)  *Mb)  +  Mo)  ■¥•  P2 ( p) )  ■ 

The  noninteraction  part  is  simply  the  sum  of  the  OTFs  of  each  subpupil  acting  by  itself,  and  this  is  highly 
constraining.  This  is  made  evident  mathematically  by  their  representation  as  autocorrelations.  It  should 
not  come  as  a  surprize  that  autocorrelation  functions  (e.9.,  Mb)  4-  Mb))  are  highly  constrained,  because 
they  are  the  Fourier  transforms  of  nonnegative  real  functions  (|pi(x)|2).  The  Interaction  part  of  the  OTF 
is  represented  by  correlations,  and  is  relatively  unconstrained.  Moreover,  the  spatial  offset,  A,  between 
Pi (u )  and  P2 (u )  translates  into  a  spatial  frequency  offset  which  separates  the  interaction  portion  of  the 
OTF  from  the  noninteraction  portion  (Figures  3d  and  5a). 

2.2  Temporal  carrier  case 

W.  T.  Rhodes3has  shown  how  a  Mach-Zehner  Interferometer  may  be  used  tb  optically  superimpose  two  distinct 
pupils  without  a  spatial  offset  (Figure  4).  Once  again  the  OTF  consists  of  interaction  and  noninteraction 
terms,  but  in  this  case  they  are  separated  by  inserting  a  phase  shifting  element  in  one  of  the  interferometer 
paths.  The  overall  pupil  function  becomes 


P!b)  *  Mb)  exp(iq)  +  Mb)  . 


16) 


The  interaction  portion  of  the  OTF  is  given  by 

(Mb)  Mb)  exp( i <b)  +  Mb)  Mb)  exp(-i$))  , 
and  the  noninteraction  portion  by 


(Mb)  *  Mb)  +  Mb)  Mb))  . 

Notice  that  the  noninteraction  portion  is  insensitive  to  the  phase  shifting  element.  The  output  image  may  be 
recorded  twice,  once  for  $  *  0  and  once  for  *  *  it,  and  by  subtraction,  the  effective  OTF  will  be  given  purely 
by  the  unconstrained  interaction  portion  of  the  OTF,  (Mb)  ♦Mb)  +  Mb)  ♦  Mb)).  If  $  and  0.  «  -fis 
used,  one  obtains  exp(1f)(pi(b)  ♦  Pi(b)  -  p2(b)  ♦  Pi(b)).  These  two  Independent  interaction  OTF  are  linear 
combinations  of  the  positive  and  negative  frequency  portions  of  the  interactive  OTF  obtained  when  a  spatial 
offset  is  employed  (Figure  3d  and  5a).  The  analogy  becomes  complete  If  we  shift  the  phase  $  linearly  in 
time;  then  the  temporally  offset  interaction  portions  of  the  OTF  become  tagged  with  positive  and  negative 
carriers  (Figure  5b). 

The  analysis  following  Eqs.  (5)  and  (6)  shows  that  the  OTF  synthesis  problem  is  the  same  for  both  the 
spatial  and  the  temporal  carrier  cases.  One  starts  with  an  application  that  demands  a  particular  filter 
function;  then  one  searches  for  two  pupils  whose  cross  correlation  yields  the  desired  filter.  This  is  a 
rather  mathematical  way  to  phrase  the  problem.  Other  approaches  will  be  considered  in  the  next  section.  Be¬ 
fore  moving  ahead  to  OTF  synthesis,  however,  we  must  make  good  the  promise  of  Section  1  to  illustrate  how 
the  advantages  we  claimed  for  noncoherent  processors  arise.  We  accomplish  this  by  tracing  coherent  and  non¬ 
coherent  Illumination  through  representative  systems:  Figure  6A:  Collimated  coherent  light  traverses  the 
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Fig.  4.  Temporal  offset  noncoherent  processor 
(Pi.  P2:  pupil  functions;  BS:  beamsplitter; 
dynamic  phase  shifting  element) 


Fig.  5.  OTFs  obtained  with  carrier  methods: 

(a)  spatial  carrier  method,  (b)  temporal  carrier  method 


input  device,  picking  up  noise  introduced  by 
thickness  variations,  striae  or  fingerprints. 
This  phase  noise  propagates  into  amplitude  and 
phase  distribution  downstream.  Figure  6b:  un¬ 
collimated,  noncoherent  light  traverses  the  in¬ 
put  device,  its  intensity  unperturbed  by  opti¬ 
cal  phase  noise.  Since  the  noncoherent  light 
is  uncollimated,  it  beams  out  every  element  of 
the  data  pattern  presented  by  the  input  de¬ 
vice  over  the  entire  aperture  of  the  optics 
downstrea,  so  that  this  information  (repre¬ 
sented  by  transmission  variations  across  the 
input  device)  is  carried  redundantly  to  the 
output  detector.  Figure  6a:  Because  the 
input  coherent  light  is  collimated,  dust  on 
optics  near  the  Fourier  plane  blots  out  tiny 
elements  of  the  coherent  transfer  function, 
corrupting  the  intended  function  of  the  pro¬ 
cessor.  Figure  6b:  Dust  on  optics  intro¬ 
duces  only  a  slight  degradation  to  the  output 
image,  because  the  noncoherent  light  is  un¬ 
collimated  and  rays  blocked  by  dust  are  com¬ 
pensated  by  rays  carrying  the  same  information 
which  pass  through  other  portions  of  the  lens 
aperture.  Figure  6a:  Coherent  light  scat¬ 
tered  by  dust  propagates  to  the  output  where 
it  interferes  with  unscattered  light,  forming 
parasitic  fringes  that  further  degrade  the 
image.  The  dynamic  range  of  the  output  de¬ 
tector  is  also  poorly  utilized  by  the  coherent 
processor,  because  the  detector  senses  light 
intensity,  while  it  is  the  light  amplitude 
that  carries  the  output  Information.  As  a 
consequence,  an  output  dynamic  range  of  only 
VT  is  realized  through  the  detector  has  a 
range  of  D  before  saturating.  Figure  6b: 
noncoherent  light  scattered  by  dust  forms  a 
uniform  output  bias.  Although  noncoherent 
techniques  generally  Introduce  additional  bias 
illumination,  the  resultant  reduction  in  image 
contrast  is  acceptable;  the  output  information 
is  represented  linearly  by  Intensity,  so  that 
a  bias  level  of  B  leaves  a  useful  dynamic 
range  (D-B)  for  the  output  Information.  It 
can  happen  that  (D-B)  <  vTJ7  and  in  this  case 
coherent  processing  stands  to  provide  the 
greater  dynamic  range.  Even  in  here,  however, 
the  advantage  may  be  negated  by  the  inevitably 
greater  noise  floor  of  coherent  optics. 

Figure  6a:  The  spatial  filter  must  be  pre¬ 
cisely  positioned  because  the  coherent  system 
uses  collimated  light.  Figure  6b:  In  the 
noncoherent  system,  the  transverse  positioning 
of  the  pupil  mask  is  Irrelevant,  except  for 
extreme  mispositioningswhich  cause  vignetting. 


Although  not  reflected  in  the  figure,  there  are  two  reasons  why  the  noncoherent  system  may  provide  a  larger 
space-bandwidth  product  than  the  coherent  system:  1)  The  reduction  in  system  noise  afforded  by  noncoherent 
optics  permits  the  use  of  multiple  element  lenses  corrected  over  a  wide  field  of  view;  coherent  optical  sys¬ 
tems  generally  must  accept  simpler  lenses  with  long  focal  lengths  because  multiple  element  optics  tend  to 
prohibitively  Increase  system  noise.  The  longer  focal  lengths  overly  constrain  the  achievable  space-bandwidth 
product  for  a  given  overall  processor  size.  2)  For  a  given  lens  aperture,  the  amplitude  Impulse  response  is 
wider  and  has  higher  sidelobes  than  the  corresponding  intensity  Impulse  response.  Consider  for  example 
s1n(x)/x  versus  (sin(x)/x)2:  full  width  at  half  maximum,  3.79  vs  2.79  radians;  first  sidelobe  height, 

.21  vs  .05.  The  sidelobes  of  the  coherent  system  may  be  reduced  by  apodizing,  but  this  will  only  serve  to 
broaden  the  width  of  the  central  peak. 

Of  all  these  advantages,  we  believe  the  most  Important  to  be  the  superior  noise  performance  of  noncoherent 
optics.  Although  most  of  the  evidence  in  this  regard  is  experimental,  a  careful  theoretical  study  by  Chavel 
and  Lowenthal  concludes:10 
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Fig.  6a.  Representative  coherent  optical  processor 


Fig.  6b.  Representative  noncoherent  optical  processor 


"  ...  it  is  never  a  disadvantage,  with  respect  to  noise,  to  use  incoherent  illumin¬ 
ation,  and  therefore  that  incoherent  optical  processing  should  be  used  whenever 
possible.  In  a  coherent  optical  processing  setup,  clearness  and  optical  quality 
of  the  components  are  of  crucial  importance  everywhere,  with  the  consequence  that 
it  is  very  difficult  to  overcome  noise  problems,  whereas  in  an  incoherent  setup, 
noise  due  to  the  optical  components  is  relatively  harmless,  and  attention  need 
only  be  given  to  amplitude  defects  of  the  object  plane  (grain  noise,  dust)." 

3.  OTF  Synthesis  Techniques 

In  every  branch  of  signal  processing,  analog  as  well  as  digital,  a  considerable  effort  has  been  devoted  to 
the  design  of  filters  for  linear  signal  processing.  In  digital  processing  the  effects  of  roundoff,  sampling 
paramters,  aliasing.  Interpolation  (for  conversion  between  polar  and  cartesian  coordinates  in  sensor  array 
processing,  etc.),  and  the  pros  and  cons  of  direct  convolution  versus  frequency  filtering  using  DFTs  (discrete 
Fourier  transforms)  must  all  be  carefully  considered.  Similar  problems  arise  in  analog  signal  processing, 
and  in  addition  one  must  contend  with  device  limitations  such  as  charge  transfer  inefficiency  in  CCDs,  sound 
wave  attenuation,  reflection  and  diffraction  in  SAWs,  etc.  Although  work  is  still  going  on,  progress  in 
understanding  and  underlying  physics  of  SAW  devices  has  been  sufficient  to  permit  analytic  design.11  Our 
objective  here  is  to  provide  the  foundation  for  such  design  techniques  in  noncoherent  pupil  mask  processors. 

To  avoid  confusion  we  restrict  the  discussion  of  OTF  synthesis  to  the  spatial  carrier  case;  as  we  have  seen 
in  Section  2,  the  close  analogy  between  the  spatial  and  temporal  carrier  cases  permits  results  in  one  case  to 
be  useful  in  the  other.  One  begins  with  a  given  convolution  or  spatial  filtering  requirement  demanded  by  a 
particular  application.  One  then  follows  the  recipes  of  Lohmann1  or  Stoner12  to  install  the  desired  frequency 
filter  on  a  physically  valid  OFT.  Equivalently,  one  may  encode  the  desired  convolution  function  with  a 
spatial  frequency  carrier  as  a  nonnegative,  bandlimited  and  hence  physically  valid  PSF.  For  our  present  pur¬ 
poses,  it  is  convenient  to  work  directly  with  such  an  encoded  PSF.  Recalling  Eq.  (3),  we  now  ask  what  p(x,y) 
corresponds  to  our  F( x ,y) .  It  is  easy  to  solve  for  (p|  by  taking  the  square  root  of  F.  It  may  also  seem  easy 
to  multiply  Ip!  by  an  arbitrary  phase  factor,  exp(1e{x,y)) ,  and  to  Inverse  transform  to  obtain  p(u,v).  The 
catch  is  that  p(y,v)  cannot  go  on  forever,  but  must  be  zero  for  u.v  >  R/FX,  where  R  is  the  radius  of  the  pro¬ 
cessor  lenses.  Arbitrary  choices  of  o(x,y)  lead  to  discontinuities  in  p(x,y)  which  correspond  to  a  p(u,v)  of 
Infinite  extent.  If  only  the  central  region  of  this  P(y,v)  is  used,  a  smoothed  approximation  to  F(x,y)  is 
obtained  which  will  not  exactly  satisfy  Eq.  (3).  It  Is  clear  that  we  need  both  a  way  of  specifying  good 
choices  of  e(x,y)  and  a  criterion  for  assessing  the  approximation  we  achieve  to  F  and  F. 
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The  design  techniques  we  require  are  quite  closely  related  to  the  techniques  developed  to  design  computer 
generated  holograms  (CGH).  The  earliest  CGSs  were  simply  mimics  of  the  holograms  which  can  be  obtained  ex¬ 
perimentally;  in  particular,  they  used  a  spatial  carrier  frequency  to  encode  phase.  An  undesirable  limitation 
of  this  early  approach  is  that  the  spatial  carrier  uses  up  a  large  fraction  of  the  plotting  capacity  of  the 
plotter  or  scanner  which  is  used  to  compose  the  hologram.  Moreover,  the  diffraction  efficiency  of  thin  ampli¬ 
tude  holograms  is  poor.  Even  earlier  work  of  Tsujiuchi13  demonstrated  that  true  complex  wave  modulation  was 
achievable  by  forming  a  sandwich  filter  consisting  of  an  amplitude  modulating  transparency  and  a  phase  modu¬ 
lating  transparancy.  Registration  of  the  transparencies  is  critical,  however.  Chu  and  Fienup111  recently 
found  a  practical  way  to  produce  such  phase  and  amplitude  sandwiches.  Multi-emulsion  film,  such  as  Kodak 
kodachrome  color  reversal  film,  contains  film  layers  which  can  be  separately  exposed,  by  using  exposures 
with  different  colors.  After  development,  the  resulting  blue  and  red  dye  Images  can  be  used  to  control  the 
amplitude  and  phase  of  a  transmitted  HeNe  (red  light)  beam,  because  the  red  dye  predominantly  Influences  the 
phase  of  the  transmitted  beam,  while  the  blue  dye  predominantly  influences  its  amplitude.  Because  no  spa¬ 
tial  carrier  is  needed  to  encode  phase,  the  image  is  produced  on-axis  and  so  this  type  of  CGH  contains  no 
trace  of  analog  to  the  reference  beam  of  conventional  holography.  Hence  the  name  ROACH  —  Referenceless 
On-Axis  Complex  Hologram.  Fienup's  work15  was  directed  towards  using  ROACHs  in  computer  memories.  This 
application  demands  good  image  fidelity,  in  order  to  achieve  low  bit  error  rates.  For  this  reason  careful 
work  was  done  to  improve  the  process  of  making  good  holograms.  The  photographic  process  had  to  be  well  under¬ 
stood,  and  beyond  this,  techniques  were  studied  which  attempt  to  find  good  choices  for  the  phase,  $(x,y), 
of  the  holographically  constructed  image  wavefront  p(x,y).  Fienup's  work  followed  up  on  an  iterative  phase 
construction  technique  developed  by  Gerchberg  and  Saxon.  6 

Many  pupil  functions  for  noncoherent  optical  processing  have  already  been  found  without  avail  to  an  arsenal 
of  phase  construction  techniques. 12  However,  such  an  arsenal  is  extremely  desirable,  because  noncoherent 
processing  cannot  be  fully  exploited  without  techniques  for  finding  the  optimal  (in  some  sense  to  be  deter¬ 
mined)  pupil  function  j5(u,v)  for  implementing  a  given  F{u.'->)  and  F(x,y).  For  this  reason  we  took  a  broad  look 
at  the  phase  construction  problem.  It  occurs  in  many  disciplines,  including  electrical  engineering,  radio- 
astronomy,  speckle  interferometry,  x-ray  crystallography,  elementray  particle  physics,  and  optics.  We  sought 
general  solutions  to  the  problem.  The  outline  below  gives  an  overview  of  the  discussions  that  follow. 

General  Techniques  For  Phase  Construction 
e  Given  only  F(x)  or  F(x,y): 

-  1-0  case:  analyticity  and  Hilbert  transforms 

-  our  heuristic  extension  into  2-0 

-  the  feasibility  of  large-scale  optimization 

e  Given  F(x,y)  and  a  guess  for  |  (5(u,v)  |  :  , 

-  Gerchberg- Saxon  iteration 

-  Dallas'  algebraic  solution 

3.1  General  techniques  for  phase  construction 

3.1.1  The  use  of  Analyticity 

This  approach  to  the  phase  problem  follows  contributions  made  almost  simultaneously  be  neither  and 
O'Neill,17  Hofstetter,1’  and  Goldberger,  Lewis,  and  Watson.1’  It  is  interesting  that  these  scientists  are 
respectively  from  the  disciplines  of  optics,  electrical  engineering,  and  physics.  They  followed  a  general 
approach  first  Introduced  by  physicists  studying  scattering  (Kramers  and  Kronig)  and  by  electrical  engineers 
studying  electrical  filters  (H.  W.  Bode).20  A  serious  limitation  of  this  approach  is  that  it  covers  only 
the  1-dlmensional  case,  but  we  have  developed  a  heuristic  extension  for  the  2-dimensional  case. 

The  analysis  of  the  1-dimensional  case  Involves  analytic  continuation  of  the  1-dimensional  PSF  into  the 
2-dimensional  complex  plane;  we  shall  recite  the  form  of  the  analysis  and  refer  the  reader  to  the  re¬ 
ferences'7"20  for  their  justification: 


F(x)  —  F(z);  F(z)  •  p(z)  p*(z*)  (7) 

Analysis  of  F(z)  reveals  that  is  is  a  product  over  Its  zeros  In  the  complex  phase.  Furthermore,  because  F(z) 
limits  to  F(x)  as  z  approaches  the  x  axis,  it  follows  that  the  zeros  of  F(z)  occur  in  complex  conjugate  pairs; 
if  zi  is  a  zero,  so  Is  z*.  This  ensures  that  F(z)  is  nonnegative  real  on  the  x  axis.  The  pairing  of  zeros 
Introduces  an  ambiguity  in  p(z),  because  there  is  no  way  to  decide  whether  to  pick  out  the  factor  (z-zi)  or 
(z-zp  when  constructing  p(z)  from  F(z).  Both  choices  lead  to  the  same  expression  for  F(z),  and  consequently 
to  the  same  expression  for  F(x).  The  process  of  changing  from  (z-zi)  to  (z-z*)  is  called  zero-flipping. 

Given  F(x) ,  if  we  could  only  find  one  of  the  p(z)  we  would  have  its  zeros,  zi,  and  we  could  play  the  zero 
flipping  trick  to  find  any  of  the  other  p(z)  we  wish.  (Since  the  number  of  complex  zeros  may  be  zero,  finite 
or  infinite,  there  may  be  only  one  acceptable  p(x),  a  finite  number,  or  an  infinite  number.) 

An  expression  does  exist  for  one  of  the  p(z).  This  special  p(z)  has  all  of  its  zeros  in  the  lower  half 
olane.  It  is  known  as  the  minimum  phase  solution.  This  term  comes  from  electrical  circuit  theory.20  The 
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time  delay  of  an  electrical  impulse  through  a  linear  circuit  is  related  to  the  phase  of  the  filter  frequency 
response.  Of  all  the  electrical  circuits  with  the  same  frequency  response  magnitude,  the  one  which  intro¬ 
duces  the  least  delay  has  the  least  phase  variation.  In  our  context,  an  analogous  statement  holds.  The 
minimum  phase  p(z)  corresponds  to  the  p(y)  which  is  maximally  concentrated  at  y*o  in  the  following  sense: 


1  P(u)  I2  d-  >  /  |p(.)| 
mm.  phase  o 


du  for  all  a. 


The  phase,  $(x),  of  the  minimum  phase  amplitude,  p(x)  *  |p(x)|  exp(ip(x)),  is  given  by  the  Hilbert  transform 
of  log  (|f(x)|^): 


ij 


We  now  have  a  recipe  for  computing  the  set  of  j5(w)  which  correspond  to  a  given  F ( x ) :  Use  Eq.  (9)  to  compute 
p(x)  *  VF(x)  exp  ( i <p ( x )  ).  Fourier  transform  to  obtain  j5(u);  then  Laplace  transform  to  obtain  p(z),  the 
analytic  continuation  of  p(x).  Compute  the  zeros  of  p(z)  out  to  a  large  value  of  |zl  (they  all  lie  on  the 
lower  half  plane).  Obtain  equally  acceptable  p(z)  by  zero-flipping.  Fourier  transform  the  corresponding 
p(x)  to  obtain  new  j5(y).  Choose  the  p(y)  which  is  most  easily  fabricated. 

3.1.2  Two  dimensional  extension 

Given  F(x,y),  fix  y  to  obtain  the  1-dimensional  function  F(x,y’).  Compute  the  zeros  z,  of  the  corre¬ 
sponding  analytically  extended  minimum  phase  amplitude,  which  we  denote  by  p(z.y').  Consider  F(x,y'+e)  for  c 
much  less  than  the  Nyquist  sampling  Interval.  By  continuity,  the  zeros  z-j  of  p(z,y'+e)  must  approach  the 
zeros  of  p(z,y')  as  e  approaches  zero.  If  one  stacks  up  the  complex  planes  for  increments  of  y',  (Figure  7), 
the  locus  of  the  zi  are  continuous  curved  lines  occupying  the  Imag(z)  <0  half  of  the  3-dimensional  space 
(z,y‘).  By  continuity,  these  loci  cannot  end  abruptly;  however,  they  can  move  off  towards  infinite  |z|  . 

In  this  way  it  is  possible  for  the  character  of  the  minimum  phase  p(z,y‘)  to  vary  with  y'. 

We  have  not  carefully  investigated  the  properties  of  the  function  p(z.y').  It  is  clearly  a  close  cousin 
to  the  minimum  phase  amplitude  in  the  1-dfmensional  case,  and  it  limits  to  this  amplitude  if  F(x,y)  «  F(x). 
Even  if  the  Fourier  transform  of  p(z*x,y)  leads  to  an  unsatisfactory  f>(p,v),  it  can  be  expected  to  provide 
a  good  starting  |jS(y,v)|  for  the  iterative  phase  construction  algorithm  discussed  in  Section  3.1.4. 

3.1.3  The  feasibility  of  large-scale  optimization 

Given  F(x,y),  is  it  possible  to  find  a  least  square  fit  F’(x,y)  by  optimizing  parameters  in  the  pupil? 

If  F(x,y)  has  very  little  detail,  and  maj;  be  represented  by  a  few  samples,  F(i,j),then  p(u,v)  may  also  be 
adequately  represented  by  a  few  sanples  p(n,m).  Optimization  in  ten  variables  can  be  done  rather  easily 
by  computer,  but  the  computation  time  for  unstructured  optimization  Increases  as  the  square  of  the  number  of 
variables,  and  so  the  largest  problems  solvable  with  general  purpose  optimization  routines  like  Fletcher- 
Powell  on  today's  computers  must  have  fewer  than  200  variables.  Unfortunately,  optical  processing  has  an 
advantage  only  when  large  amounts  of  data  Is  to  be  processed,  and  therefore  we  are  interested  in  F(x,y) 
which  must  be  represented  by  millions  of  variables!  Thus  we  would  need  to  solve  an  optimization  problem 
that  Is  one  hundred  million  times  larger  than  the  largest  problems  feasible.  It  is  clear  that  brute  force 
optimization  procedures  are  useful  only  on  small  test  problems  that  might  be  of  interest  in  benchmarking 
other  approaches;  however,  selective  use  of  optimization  in  conjunction  with  other  techniques  remains  a 
strong  option. 

3.1.4  Gerchberq-Saxon  iteration 

Given  F(x,y)  and  a  guess  for  |j5(v,v)|,  a  technique  originated  by  Gerchberg  and  Saxon1*  is  applicable.  A 
reasonable  choice  is  |p(u,v)|  *  1  within  the  open  aperture  of  the  Imaging  lenses,  and  |p(u,v)(  *  0  outside, 
because  this  choice  corresponds  to  the  most  efficient  possible  pupil  function.  This,  of  course,  is  no 
guarantee  that  the  iterative  algorithm  will  converge  to  a  solution,  because  the  given  F(x,y)  may  be  incon¬ 
sistent  with  |p(u,u)  |  *  1. 

The  principle  behind  the  Gerchberg-Saxon  iteration  is  that  the  phase  function  over  the  pupil  affects  the 
output  intensity  distribution  F(x,y).  The  given  F(x,y)  therefore  contains  implicit  Information  about  the 
phase  8(x,y)  of  j5(y,v).  The  problem  Is  to  combine  this  implicit  phase  information  with  (p(u,v)|.  Gerchberg 
and  Saxon  proceed  iteratively:  Choose  a  random  Inital  phase  &i(u,v)  for  pi(u,v)  *  |P(u,v)| exp(l6»(x,y)  ). 
Compute  Pi(x,y)  ■  |pi(x,y)  exp(1$>(x,y)  )  by  Fourier,  The  error  In  6i  causes  an  error  in  both  |p;(x,y)|  and 
®»(x,y).  Correct  iPi(x.y)  by  replacing  it  with  VF(x,y).  Compute  a  revised  pupil  phase  e2(u,v)  by  Fourier 
transforming  VF(x,y)  exp(i*i(x,y)  ).  This  cycle  from  the  pupil  plane  to  the  output  plane  and  back  has  the 
effect  of  Injecting  into  62,  es,  ....  6j,  the  phase  Information  which  Is  implicitly  contained  In  F(x,y). 
Although  the  iteration  may  not  converge  to  a  pupil  function  which  accurately  produces  an  output  intensity 
F(x,y),  It  can  be  shown  that  the  mean-squared  error  between  the  estimates  F<(x,y)  and  F(x,y)  reduces  (perhaps 
only  Infinitesimally)  with  each  Iteration.  In  the  process,  8j(u,v)  end  4>j(x,j)  also  become  more  accurate. 
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Fienup  has  devised  an 
over-relaxation  techni¬ 
que  which  speeds  up 
convergence,  and  has 
achieved  some  Impres¬ 
sive  results  on  related 
problems. 

3.1*5  Dallas*  algebraic 
approach 

An  approach  which 
directly  combines  the 
information  provided  by 
F(x,y)  with  the  Infor¬ 
mation  provided  by 
|ji(p,v)  |  was  developed 
by  Dallas.21  The  pro¬ 
cedure  is  algebraic, 
and  works  with  samples 
of  F(x,y)  and  |p(u,v)l. 
A  criterion  related  to 
that  of  Nyqulst  Is  used 
to  determine  the  samp¬ 
ling  Interval.  First, 
all  of  the  information 
is  gathered  into  the 
pupil  domain  by  applying 
a  Discrete  Fourier 
Transform  (DFT)  to 
F(1,j).  In  analogy  to 
Eq.  (4),  one  obtains 
the  autocorrelation  of 
fKm.n): 

f(t,k)  -  (10) 

y]  j5(m+fl,n+k)j5*(m,n) 


S  I  /l  y  b  , ,  s-J  Together  with  the  given 

'Vv-  i  I  /  \  *  values  of  |j$(m,n)|, 

-  /  I  /  __  V-N/^V' — .  ^  Eq.  (10)  may  be  pro- 

7  ' - gressively  solved  for 

I  p(m,n).  At  each  step, 

choices  are  encountered 
which  may  lead  to  al- 

C4„  t  niy  temate  consistent  so- 

Flg.  7.  Zeros  of  p(z,y  )  lutlons  for  j5(m,n).  We 

view  this  as  a  strong 
point  of  the  approach, 

because  It  leads  to  all  possible  solutions  for  the  pupil  function.  The  procedure  has  been  carried  out  by 
hand  on  small  1-0  test  cases.  However,  we  have  found  no  reports  of  its  successful  application  on  large  2-D 
problems. 

3.2  Pupil  function  replication  In  OTF  synthesis 

In  the  above  discussions  explicit  reference  has  been  made  to  the  bandlimlted  properties  of  physically 
valid  PSFs.  This  is  perhaps  overly  confining.  Lohmann1,  and  Sraunecker,  Hauck,  and  Rhodes6  advocate  just 
the  opposite!  They  point  out  that  sampled  convolution  functions  are  perfectly  acceptable  in  practical  ap¬ 
plications,  and  that  this  discrete  structure  of  the  P$F  will  tend  to  negate  the  problems  associated  with 
the  choice  of  phase  for  p(x,y).  This  being  the  case,  they  proceed  to  advocate  a  random  phase,  because  this 
choice  spreads  the  bandwidth,  and  leads  to  "homogenized"  pupil  functions.  In  other  words,  the  choice  of  a 
random  phase  leads  to  greater  redundancy  In  the  pupil.  There  Is  a  penalty  fmposed  by  this  approach:  the 
resultant  PSF  Is  faithful  only  on  the  discrete  sampling  lattice,  and  at  points  In-between  the  sampling 
lattice  spurious  garbage  is  Introduced.  Sraunecker,  Hauck,  and  Rhodes  show  that  this  garbage  can  be  elimin¬ 
ated  by  simply  replicating  the  pupil  over  a  2-D  grid.  In  effect,  they  trade-off  the  bandwidth  of  the 
processor  In  order  to  reduce  noise.  We  cen  Intuitively  understand  their  results  by  not1n9  that  the  repll** 
cated  pupil  leads  to  a  much  finer  sampling  structure  over  the  PSF  than  the  basic  unrep Heated  pupil  achieves. 
This  more  precise  sampling  structure  picks  out  faithfully  constructed  portions  of  the  PSF  and  blanks  out 
the  garbage  In-between.  This  effect  is  shown  dramatically  In  Figure  5  of  their  paper.  As  a  valuable  side- 
benefit,  the  replication  adds  redundancy  to  the  overall  pupil,  and  this  reduces  the  adverse  effect  of  grain 
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in  the  pupil  mask  or  dust  on  the  processor  optics.  This  approach  is  direct,  relatively  simple,  and  effec¬ 
tive.  It  may  be  implemented  with  either  an  off-axis  CGH  cr  an  on-axis  ROACH.  At  this  time,  it  is  the  best 
method  known  for  OTF  synthesis. 


4.  Applications  and  Directions  For  Futher  Work 

In  the  four  years  since  OTF  synthesis  was  first  proposed  as  an  alternative  to  coherent  optical  processing, 
over  twenty  papers  have  been  published  by  seven  groups  worldwide.  Reviewing  this  work  we  ask  what  the  logi¬ 
cal  next  steps  are,  and  how  this  work  might  be  channelled  to  achieve  the  greatest  impact.  In  answering 
these  questions,  we  are  guided  by  the  recent  challenge  of  Guenther,  Christensen,  and  Upatnieks,22  who  suc¬ 
cessfully  demonstrated  real  time  correlation  tracking  and  target  identification  with  a  coherent  optical  pro¬ 
cessor  anticipated  to  have  an  ultimate  package  size  of  50  cubic  centimeters.  The  proponents  of  noncoherent 
optical  processing  claim  that  it  can  do  the  same  general  complex  valued  or  bipolar  filtering  and  correlation 
operations  as  coherent  optical  processing,  and  that  noncoherent  processors  can  do  so  with  superior  perfor¬ 
mance.  The  application  chosen  by  Guenther,  Christensen,  and  Upatnieks  is  one  that  loo.ks  to  be  within  reach 
of  the  available  OTF  synthesis  techniques:  CGHs  of  PSFs  with  relatively  small  space-bandwidth  products  are 
all  that  is  needed  for  correlation  of  simple  targets.  Let's  make  themost  of  our  presently  developed  non¬ 
coherent  optics  in  this  application!  In  this  context,  we  must  mention  the  run-off  between  coherent  and  non¬ 
coherent  techniques  for  color  coding  of  spatial  frequencies  recently  performed  by  Indebetouw. 2 3  This  result 
clearly  demonstrated,  at  least  in  this  application,  the  superiority  of  noncoherent  over  coherent  processing. 

In  general,  more  work  needs  to  be  done  on  real  time  noncoherent  processing,  in  order  to  move  into  specific 
applications.  The  work  of  Gorlitz  and  Lanzl 24  with  a  color  encoded  pupil  In  conjunction  with  a  color  video 
camera,  and  the  work  of  Barrett,  Greivenkamp,  Gordan,  Gmitro,  Chui,  and  Swindell25  on  real  time  noncoherent 
optical  processing  for  transaxlal  tomography  are  examples  of  significant  progress  in  this  direction. 

At  the  present  time,  the  most  accessible  applications  are  those  which  permit  a  fixed  pupil  mask  to  be 
used.  Dynamically  changing  the  pupil  mask  will  require  further  work  on  pupil  mask  design  and  OTF  synthesis, 
as  well  as  work  on  programmable  spatial  light  modulators.  Examples  of  applications  using  fixed  masks  in¬ 
clude  1}  detection  of  a  small  class  of  targets  or  signals,  2)  reformatting  of  data,  3)  Fourier  transformation 
using  the  chirp  transform  algorithm12,  4)  frequency  excision  of  fixed  frequency  bandstand  5)  image  pro¬ 
cessing  such  as  in  transaxial  tomography  or  image  characterization.23 

Applications  which  appear  less  accessible  at  this  time  include  correlation  or  convolution  of  two  signals 
both  having  large  space-bandwidth  products,  because  this  will  involve  improvements  in  techniques  for  de¬ 
signing  pupil  functions  and  constructing  pupil  masks.  Work  should  be  done  to  push  and  define  the  limits  of 
the  presently  known  techniques.  Work  should  also  be  done  to  explore  the  feasibility  of  using  present  day 
acousto-optical  devices  and  SLMs  for  dynamically  controlling  the  pupil  plane.* 
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Discussion  (William  W.  SConer;  Discussion  Leader:  William  T.  Rhodes) 

C.  In  looking  for  future  directions,  it  is  clear  that  real-time  operations  should  be  investigated.  I've 
always  claimed  that  coherent  optical  techniques  aren't  very  well  suited  to  the  real  world  and  that  they  are 
going  to  remain  in  a  laboratory  environment.  Non-coherent  systems  are  very  robust,  and  it  has  only  been  a 
question  of  how  you  can  harness  such  systems  to  do  optical  signal  processing.  The  particular  task  of  track¬ 
ing  and  correlating  a  target  against  a  background  has  been  done  successfully  with  a  coherent  system,  and  that 
should  be  within  reach  of  noncoherent  optics. 

C.  What  we  need  are  run-offs  between  coherent  and  noncoherent  systems.  Recently  an  article  described  a 
runoff  becween  a  coherent  and  noncoherent  processor  in  an  application  for  image  characterization.  The  object 
was  to  take  an  image  and  pick  out  the  different  spatial  frequency  bands  by  color  coding.  They  found  that, 
in  this  particular  case  anyway,  the  noncoherent  techniques  were  superior.  Runoffs  are  something  that  could 
be  done  In  universities  very  easily,  a  good  thesis  project.  Another  thing  that  would  be  interesting  to  look 
at  with  a  spatially  incoherent  syscem  Is  the  dollar  bill  recognition  experiment. 

Q .  1  was  visiting  a  company  and  saw  a  machine  they  built  which  was  basically  a  slide  viewer.  They  used  an 

incandescent  source  with  a  small  filament,  and  they  did  spatial  filtering  to  enhance  the  contrast  of  the 
slides.  Do  you  foresee  that  these  techniques  would  allow  spatial  filtering  to  be  done  in  normal  optical 
Instruments,  such  as  binoculars?  Or  a  camera  that  has  a  knob  you  can  turn  to  sharpen  the  image? 

A.  It's  a  simple  enough  operation,  yes.  There  was  a  company  selling  a  pupil  mask  which  was  just  an  apodlz- 
ed  mask  that  you  put  over  your  lens.  It  was  a  photographically  made  disk  chat  was  opaque  in  the  center  and 
gradually  got  more  transparent.  If  you  are  doing  standard  darkroom  work  and  you  want  to  blur  out  a  picture, 
you  might  do  chat  by  de-focuslng.  But  when  you  put  one  of  these  masks  on,  the  mls-focused  OTF  improves.  So 
there  are  applications  for  pupil  masks  that  have  been  around  for  awhile.  If  you  want  to  sharpen  the  image, 
you  are  in  trouble  because  you  need  an  OTF  that  inhibits  low  spatial  frequencies  relative  to  high,  and  that 
violates  the  positivity  requirement. 


Q.  Does  it  require  some  electronic  post-filtering? 

A.  You  need  that  if  you  want  to  do  anything  like  edge  enhancement. 
Gordon  Rogers'  procedure  of  using  a  large  bias  term. 


But  there  are  other  techniques,  like 


C.  There  is  still  the  broadband  nature  of  a  scene  you  photograph  with  a  camera.  A  limited  number  of  OTF 
syntheses  will  work  with  broadband  Illumination,  but  if  you  are  trying  to  do  a  variety  of  information  proc¬ 
essing  tasks  that  would  be  of  interest  to  this  community,  then  you  need  to  stick  with  narrowband  Illumination. 

R.  Whenever  you  want  a  sharp  feature  in  the  Fourier  domain,  you  need  narrowband  illumination.  But  if  you 
have  Just  broad  features,  then  you  can  loosen  up  the  tolerance  on  the  spectral  purity  of  the  light.  Now 
let's  look  at  the  filter  I  was  talking  about,  such  as  a  notch  filter  for  an  extreme  example.  The  OTF  is  de¬ 
signed  for  one  wavelength,  and  if  you  use  another  wavelength  everything  gets  scaled.  If  the  notch  is  really 
narrow,  then  the  two  notches  won't  be  on  top  of  each  other  and  the  filter  will  be  fuzzed  out. 

C.  Maybe  one  could  sec  up  an  optical  system  so  Chat  part  of  the  OTF  synthesis  was  done  by  the  front  end. 

The  optical  syscem  or  lens  might  be  apportioned  somehow  so  as  to  have  an  OTF  that  emphasized  whatever  it 
was  you  were  looking  for.  One  can  imagine  that  being  useful  in  IR  search  and  track  where  you  are  trying  to 
extend  the  range  at  which  you  pick  up  the  target.  A  question  arises  concerning  the  S/N  ratio,  because  your 
choice  la  to  block  off  part  of  the  aperture  and  do  your  processing  with  a  reduced  amount  of  light  flux.  If 
the  choice  is  to  have  a  large  aperture,  which  is  very  heavy  and  may  be  impossible  to  get  into  orbit,  versus 
having  a  couple  small  apertures  that  you  can  move  around,  then  you  can  synthesize  a  pupil  and  get  the  effect 
of  a  large  aperture. 

C.  In  coded  aperture  Imaging  you  use  an  annulus  and  convolve  the  annulus  with  Itself.  It  occurs  to  me  that 
you  could  use  some  other  function,  like  the  I/O  filter.  There  are  probably  a  number  of  common  aspects  be¬ 
tween  coded  aperture  imaging  and  OTF  synthesis. 

C.  You  might  even  be  able  to  tailor  the  optics  in  the  front  end  with  whatever  is  convenient  to  make  in 
terms  of  the  detector  array. 
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Abstract 


A  review  of  various  approaches  to  constructing  incoherent  optical  matrix-vector  multipliers  is  presented. 
Progress  in  the  experimental  realization  of  such  processors  is  outlined  and  analytic  studies  of  performance 
limitations  are  summarized. 


Introduction 

Since  the  invention  of  the  laser,  much  work  has  been  devoted  to  the  realization  of  coherent  optical  inform¬ 
ation  processing  systems.  The  most  attractive  attribute  of  such  systems  has  been  the  inherent  parallelism 
with  which  they  can  perform  data  processing  operations.  It  appears  to  be  generally  recognized  that  the  chief 
limitations  to  the  speed  at  which  data  processing  operations  can  be  performed  by  such  systems  lie  with  the 
Input  and  output  devices.  While  the  optical  systems  themselves  are  capable  of  performing  highly  parallel 
operations,  nonetheless,  the  data  is  generally  input  through  a  single  serial  electronic  channel  and  output  in 
a  similar  fashion. 

While  the  data  to  be  processed  may  originate  in  a  serial  fashion  in  many  data  processing  problems,  nonethe¬ 
less,  there  clearly  exist  problems  in  which  the  data  is  more  fundamentally  parallel  in  nature.  Examples 
include  all  those  situations  in  which  parallel  arrays  of  sensors  gather  acoustic  or  electromagnetic  information. 
In  such  cases  it  seems  unfortunate  to  be  forced  to  multiplex  the  information  into  a  single  serial  data  stream 
for  entry  into  a  parallel  optical  data  processor. 

In  an  attempt  to  find  ways  to  overcome  the  input/output  bottleneck,  we  have  been  exploring  the  properties 
of  a  certain  class  of  optical  processors  that  are  capable  of  parallel  input  and  output  of  data.  Much  of  the 
stimulation  that  led  to  these  ideas  was  provided  by  the  work  of  Bromley  and  his  associates,1  who  devised  a 
serial  incoherent  optical  matrix-vector  multiplier.  Our  work  differs  from  this  earlier  work  primarily  through 
the  emphasis  we  have  placed  on  parallel  input  and  output,  a  requirement  that  radically  changes  the  architecture 
of  the  processor. 

In  the  material  to  follow,  we  first  introduce  the  reader  to  the  basic  concepts  underlying  the  parallel 
matrix -vector  multiplier.  Next,  we  discuss  several  different  optical  realizations  of  such  a  processor. 

Some  of  the  theoretical  limitations  to  system  performance  are  then  briefly  discussed.  Finally,  the  current 
status  of  the  experimental  systems  that  have  been  built  is  reviewed. 

Basic  System  Configuration2* s*  * 

By  way  of  background,  and  to  establish  notation,  we  brief ly^review  the  nature  of  the  data-processlng  opera¬ 
tion  we  are  attempting  to  perform.  Consider  a  column  vector  x  with  components  xQ,x. , . . . ,x^  .  representing 
N  data  samples  to  be  proceaaed.  Our  goal  it  to  multiply  this  vector  times  an  NxMu  stored  matrix  H,  , 
having  element  h  in  the  nth  column  and  mth  row.  The  result  of  this  operation  is  a  vector  v  with  compo¬ 
nents  y0.yr representing  the  processed  data.  Thus, 

y  -  £,x  .  <D 

A  single  element  y  of  the  output  vector  it  related  to  the  elements  of  the  input  vector  and  the  stored 
matrix  by  the  simple  equation 


?m 


N-l 

I 

n-0  »  n 


(2) 


Note  that  computation  of  a  tingle  y  requires,  in  general,  the  performance  of  N  multiplications  and  N-l 
additions.  We  shall  describe  methods  for  performing  these  operations  optically  and  in  parallel  for  all  M 
components  of  the  vector  y. 

We  remark  in  passing  that  the  data  processing  operation  expressed  by  Eq.(l)  is  a  very  common  one  in  practice. 
With  suitable  attention  to  sampling  rates,  any  linear  data  processing  operation  (space- invariant  or  space- 
variant)  can  be  reduced  to  this  form. 

At  this  point  it  it  convenient  to  assume  temporarily  that  the  elements  of  x,  &  ,  and  y  are  alljnon- 
negativa  and  real,  thus  allowing  them  to  be  represented  physically  by  light  intensities  (for  S  and  y)  or 
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intensity  transmit tances  (for  ).  Methods  for  extending  system  operation  to  bipolar-real  or  complex  data 
are  covered  in  Che  section  to  follow. 

With  reference  to  Fig.  1,  let  the  elements  of  the  input  vector  x  be  encered  in  parallel  as  brightness 
or  radiance  values  on  an  N-elemenc  array  of  mutually  incoherent  sources.  These  sources  could  be  light-emitting 
diodes,  or  they  could  be  lasing  diodes. 


the  function  of  the  first  box  labeled  "optics'*  in  Fig.  1  is  to  spread  Che  light  from  each  source  into  a 

vertical  column  of  light  incident  on  a  unique  column  of  che  matrix  mask.  Thus  this  portion  of  the  optical 

system  must  effectively  image  in  the  horizontal  direction  but  spread  light  uniformly  in  the  vertical  direction. 

The  matrix  mask  can  be  realized  physically  as  a  transparency  consisting  of  N*M  partially  transparent 
cells.  The  Intensity  transmittance  of  a  given  cell  must  be  proportional  to  che  value  h  of  a  particular 

macrix  element,  the  proportionality  constant  being  the  same  for  all  cells  and  assuring  cfiat  all  elements  lie 
between  0  and  1.  The  transparency  of  a  cell  can  be  controlled  by  either  adjusting  its  optical  density  or 
opening  a  transparent  subcell  with  area  proportional  to  the  matrix  value  of  interest.  Of  course,  a  combina¬ 
tion  of  these  techniques  could  also  be  used.  If  the  matrix  jj,  is  fixed,  the  transparency  can  be  photographic. 

If  it  is  desired  to  change  the  macrix  rapidly  (e.g.,  at  television  frame  rates),  a  controllable  transparency, 

such  as  a  liquid  crystal  light  valve,  can  be  used. 

As  the  light  passes  through  the  matrix  mask,  N*m  analog  multiplications  are  performed  optically.  The 
function  of  che  second  box  labeled  "optics”  is  to  perform  the  analog  additions  required  to  obtain  che  output 
components.  Thus  the  second  set  of  optics  produces,  on  each  of  the  M  photodetectors,  light  intensities 
proportional  to  the  sum  of  light  intensities  transmitted  by  individual  rows  of  che  matrix  mask.  In  order  to 
maintain  Che  integrity  of  the  M  output  channels,  these  optical  components  must  image  in  the  vertical  direc¬ 
tion  while  effectively  spreading  the  light  from  each  mask  element  horizontally. 


Each  output  detector  element  generates  a  current  chat  is  proportional  to  a  different  element  y^  of  the 
output  vector.  The  M  output  components  are  available  in  parallel. 

Achieving  Bipolar  and  Complex  Operations3 * 5 

In  practical  signal  processing  problems,  it  seldom  suffices  to  accept  only  non-negative  and  real  inputs  and 
to  subject  them  Co  only  non-negative  and  real  matrix  multiplications.  Esther,  it  is  necessary  to  extend  the 
domain  to  at  least  bipolar  real  vectors  and  matrices,  and  preferably  to  complex-valued  vectors  and  matrices. 

There  exist  many  methods  for  representing  complex  numbers  by  real  and  non-negative  components.  For  example, 
we  could  use  four  non-negative  and  real  numbers  representing  basis  components  separated  by  90°  in  the  complex 
plane,  or  three  non-negative  and  real  numbers  representing  components  separated  by  120°.  In  both  cases,  to 
arrive  at  a  unique  decomposition,  one  must  adopt  some  conventions,  such  as  two  out  of  four  (in  the  four  compo¬ 
nent  decomposition)  or  one  out  of  three  (in  the  three-component  decomposition)  or  the  components  must  always 
be  zero.  Such  encoding  circuits  entail  the  use  of  non-linear  devices  (half-wave  linear  rectifiers),  which 
broaden  the  bandwidth  of  the  driving  circuits.  More  Importantly,  each  of  these  methods  uses  more  than  two 
input  devices  (LED's)  to  represent  each  complex  number. 


A  more  efficient  method  for  performing  complex  operations  can  be  realized  with  a  two-component  decomposi¬ 
tion.  If  it  were  possible  to  realize  bipolar,  real  input  and  mask  values,  then  the  decomposition 
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would  be  possible,  where  subscripts  R  and  I  indicate  bipolar  real  and  imaginary  parts.  However,  In 
practice,  we  cannot  directly  input  bipolar  vector  elements  nor  multiply  by  bipolar  matrix  elements,  since  the 
system  is  incoherent.  Nonetheless,  we  can  bias  the  mask  and  input  vector  to  guarantee  non-negative  elements 
throughout,  in  which  case  the  components  of  the  output  vector  obtained  are  given  by 
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After  detecting  the  elements  y'  and  y^  at  the  output  of  the  matrix-vector  multiplier,  the  task  remains 
removing  the  unwanted  components  introduced  by  the  biases  and  producing  bipolar  real  and  imaginary  parts, 
and  y, ,  electronically.  The  desired  vectors  are  recoverable  from  the  measured  vectors  through  the 
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The  terms  yR  and  y'  represent  measured  data,  and  are  therefore  known.  The  first  parentheses  in  hoth  (7a) 
and  (7b)  consist  of  bias  terms,  known  a  priori,  and  therefore  removable  after  detection.  The  second  set  of 
parentheses  in  both  equations  consists  of  the  product  of  the  known  bipolar  matrices  with  the  known  bias 
vectors,  and  therefore  can  be  removed  after  detection. 


The  last  parentheses  in  the  equations  contain  products  of  the  known  bias  matrices  with  the  unknown  bipolar 
input  vectors,  and  therefore  are  unknown  a  priori.  However,  if  the  bias  matrix  ^  has  all  column  vectors 
equal  to  a  single  column  vector  t _,  and  ^  has  all  columns  equal  to  a  single  column  vector  3  ,  then 
these  particular  bias  terms  can  beKremoved  by  adding  an  H+lst  constant  row  to  the  stored  matrix  and  an  M+lst 
detector  to  the  output  array,  and  subtracting  from  each  measured  output  component  the  properly  weighted  output 
of  the  M+lst  detector. 


We  conclude  that  it  is  possible  to  Dt-'tlply  an  N-element  complex  input  vector  times  an  N*M  stored  complex 
matrix  by  inputting  data  on  a  2K-element  a, ray  of  incoherent  sources,  using  2N*(2M+1)  cell  transmission  mask, 
and  detecting  intensities  on  a  2M+1  detector  array.  The  use  of  biased  real  and  imaginary  parts  .yields  the 
minimum  number  of  input  and  output  elements. 

System  Realisation  Using  Discrete  Optical  Components 

The  first  system  that  was  built,  and  which  indeed  is  still  under  construction,  is  a  system  that  uses 
discrete  optical  components  (spherical  and  cylindrical  lenses)  to  perform  the  desired  operations.  Figure  2 
shows  the  geometry  of  the  optical  system.  Lens  L^  is  cylindrical  and  collimates  the  light  that  is  spread¬ 
ing  lr  the  direction  normal  to  the  LED  array.  Lens  combinations  L^  and  L.  consist  of  spherical  elements 
and  serve  to  image  each  LED  as  a  vertical  line  of  light  incident  on  the  matrix  mask.  Lens  L^  is  a  field 
lens  that  brings  the  central  rays  transmitted  by  each  cell  of  the  mask  to  a  common  vertical  column  centered 
on  the  vertical  detector  array.  Lens  Lj  is  cylindrical  and  images  each  row  of  the  matrix  mask  onto  a 
separate  detector  element.  All  elements  are  off  the  shelf  items,  and  the  total  cost  of  the  optics  was  about 
$200. 

The  LED  array  consists  of  10  Texas  Instruments  TIES-36  Infrared  diodes,  each  capable  of  emitting  a  milli¬ 
watt  of  9100A  radiation  into  a  cone  with  a  half-power  beam  width  of  25  degrees  (112.5  degrees).  The  LED’s  are 
mounted  with  3.5mm  center  to  center  spaclngs,  resulting  in  au  overall  array  length  of  44sra.  The  ten  separate 
drivers  for  these  sources  serve  to  convert  an  applied  input  voltage  into  a  current  passing  through  the  corres¬ 
ponding  LED.  These  drivers  were  designed  in  such  a  way  that  the  slopes  and  biases  of  their  characteristic 
curves  can  be  controlled  by  externally  applied  voltages,  such  as  might  be  provided  by  a  microcomputer,  for 
example.  The  inclusion  of  this  extra  flexibility  led  to  a  considerable  price  in  terms  of  the  linearity  of 
the  input-output  characteristics  of  the  combined  driver  and  LED.  Figure  3  shows  a  typical  plot  output-light- 
power  vs.  applied  voltage  for  such  LED  and  driver  combination.  The  curve  represents  the  output  power  as  a 
function  of  voltage  applied  to  the  drivers.  Each  channel  is  operated  with  a  bias,  which  places  the  excursions 
in  the  most  linear  region  of  the  curve. 

The  masks  used  in  this  system  have  been  constructed  in  binary  form,  with  each  matrix  element  represented 
by  a  transparent  cell  on  an  opaque  backgtound.  Initially,  the  mask  is  constructed  such  that  the  area  of  each 
transparent  opening  is  proportional  to  the  desired  value  of  that  particular  matrix  element. 

The  particular  matrix-vector  operation  for  which  the  mask  has  been  designed  is  the  discrete  Fourier  trans¬ 
form  (DFT).  For  such  an  operation,  the  number  of  output  elements  equals  the  number  of  input  elements  (N+M), 
and  the  real  and  Imaginary  parts  of  the  ideal  matrix  are 
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When  biases  are  added,  the  actual  forms  of  the  stored  matrices  are 

£  -  |[l  +  cos  £2s]  ,  H'  -  yjl  +  sin  .  (9) 

In  practice  we  have  found  it  helpful  to  view  che  matrix-vector  multiplier  as  a  kind  of  optical  memory, 
for  which  a  single  stored  analog  value  Ci.e.,  a  single  matrix  element)  can  be  read  ouc  by  turning  on  a 
particular  LED  source  and  a  particular  detector  element.  We  invariably  find  that,  once  an  ideal  mask,  has 
been  made,  an  optical  read-out  of  the  stored  weights  shows  that  there  exist  substantial  departures  from  the 
ideal  values.  There  are  many  sources  of  error,  including  vignetting  present  in  che  optics  and  errors  inherent 
in  the  way  a  height  or  width  modulation  of  an  opening  in  the  mask  affects  the  scored  weighc  read  out  optically. 
We  have  therefore  found  it  generally  necessary  to  construct  the  mask  through  an  iterative  process,  in  which 
we  begin  wich  an  ideal  mask,  read  Out  the  optically  stored  weights,  and  then  construct  a  second  mask  with 
elements  modified  in  such  a  way  as  to  bring  che  optically  stored  weights  closer  to  their  ideal  values.  The 
important  point  here  is  that  one  should  not  think  of  che  matrix  as  being  represented  solely  by  the  stored 
mask,  but  rather  by  the  entire  optical  system,  from  the  LED  array  to  the  detector  array. 

Figure  4  illustrates  two  masks,  the  first  being  ideal,  and  the  second  a  corrected  version  that  yields  more 
accurace  optically  stored  weights. 

The  detector  array  chosen  for  this  system  is  a  Centronics  LD20-3,  a  20  element  PJN  diode  array  with  all 
elements  accessible  in  parallel.  The  detectors  have  peak  sensitivity  at  about  9000A.  Only  11  of  these 
elements  are  used  by  the  system,  10  for  the  output  components  and  one  for  the  bias  channel.  The  length  of 
the  array  is  20mm.  Each  detector  element  is  followed  by  a  low-noise  pre-amplifier  and  amplifier  mounted  in 
the  system.  The  gains  and  biases  of  all  detector  channels  can  be  controlled  by  externally  supplied  electronic 
signals.  The  output  bandwidth  of  each  channel  is  approximately  10  MHz.  The  noise-equivalent- input-power  (NEP) 
of  the  detector-amplifier  combinations  is  a  few  times  10"^  uatts//f5F. 

Figure  S  shows  a  typical  output  sequence  read  out  by  means  of  a  Re tic on  CCD  array  (not  the  Centronics 
array).  This  particular  sequence  represents  the  real  part  of  the  transform  of  the  input  sequence  (1010000000). 

The  system  we  have  described  here  should  be  fully  operational  by  the  end  of  the  summer  of  1980.  Corrections 
of  limited  complexity  can  be  made  to  the  electronically  read  weights  by  microcomputer  control  of  the  gains  and 
biases  of  all  input  and  output  channels.  Figure  6  shows  a  photograph  of  the  system  (excluding  power  supplies 
and  microcomputer).  The  LED  array  and  drivers  are  located  at  Che  far  left,  while  the  detectors  and  amplifiers 
are  located  at  the  far  right.  The  entire  length  of  the  system  is  slightly  more  than  one  meter. 

System  Realization  Using  Multimode  Planar  Waveguides 

A  second  realization  of  the  matrix-vector  multiplier  is  illustrated  in  Fig.  7.  In  this  case  the  discrv** 
optical  elements  of  the  previous  system  are  replaced  by  two  arrays  of  planar  multimode  optical  waveguides  ,s 
will  be  seen,  this  realization  is  far  more  compact  than  that  described  earlier. 

Each  LED  source  now  emits  light  into  a  planar  multimode  optical  waveguide.  With  a  proper  choice  of 
dimensions  for  the  guide,  multiple  internal  reflections  of  the  light  within  the  guide  generate  a  relatively 
uniform  column  of  light  at  its  output.  Figure  8  illustrates  the  measured  distribution  of  light  intensity  for 
a  guide  with  dimensions  76. 2mmx22amxlmm.  Small  irregularities  in  this  distribution  are  smoothed  by  the  finite 
size  of  the  mask  openings.  In  addition,  iteration  of  the  matrix  mask  can  compensate  for  any  remaining  non- 
uniformities. 

Light  leaving  the  matrix  mask  passes  into  a  similar  set  of  guides  rotated  90°  with  respect  to  the  previous 
set.  The  optical  power  from  each  opening  in  the  mask  is  spread  to  cover  the  entire  end  of  the  guide  covering 
its  respective  row.  The  detector  element  intercepts  a  portion  of  the  light  at  the  guide  output. 

Figure  9  shows  a  photograph  of  the  optical  components  of  this  system.  The  entire  length  of  the  optics  is 
approximately  15  cm. 

The  weights  stored  in  such  a  system  when  an  ideal  DFT  mask  is  used  have  been  read.  The  results  show  a 
total  rms  error  of  5.32.  3y  iteration  of  the  mask,  it  should  be  possible  to  reduce  these  errors  to  about  IS. 

A  new  set  of  LED  drivers  and  detectors  is  under  construction  for  this  system.  The  linearity  of  the  new 
electronics  is  much  improved.  Figure  10  shows  che  measured  characteristic  of  a  single  input  channel. 

The  detector  array  used  in  this  system  will  again  be  a  Centronics  LD20-3.  The  overall  optical  efficiency 
of  tnis  system  is  about  a  factor  of  7  better  than  that  for  the  system  described  earlier.  Again  the  design 
bandwidth  for  each  channel  is  10  MHz. 
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System  Realization  Using  Optical  Fibers 

A  third  realization  of  this  type  of  system  has  been  constructed  with  optical  fibers.  As  illustrated  ir. 
Figure  11,  each  LED  fires  into  a  bundle  of  optical  fibers.  In  the  system  that  has  been  constructed,  there 
are  20  input  ports,  each  consisting  of  200  fibers.  Each  fiber  bundle  is  split  into  sub-bundles,  with  the 
number  of  fibers  in  one  sub-bundle  being  proportional  to  the  weight  of  one  of  the  elements  in  the  stored 
matrix.  At  a  single  output  port,  a  set  of  sub-bundles  from  all  input  ports  is  gathered  to  form  a  single  out¬ 
put  bundle.  The  light  from  chat  bundle  falls  on  an  output  detector. 

The  matrix  elements  are  stored  in  the  fiber  wiring  arrangement  of  this  system.  Each  weight  is  quantized 
to  a  number  of  levels  equal  to  the  number  of  fibers  in  a  single  input  bundle.  Figure  12  shows  a  photograph 
of  the  optical  system  that  has  been  built;  this  system  is  capable  of  performing  a  20-point  DFT. 

The  chief  advantage  of  this  particular  realization  is  its  very  high  optical  efficiency,  which  in  turn 
allows  high  throughput  speed  (due  to  improved  S/N  ratio).  The  chief  disadvantages  are  two-fold.  First,  the 
matrix  cannot  be  changed  or  iterated,  since  it  is  inherent  in  the  wiring  diagram  of  the  optical  fibers. 
Second,  and  more  important,  the  accuracy  of  the  system  is  limited  by  the  uniformity  with  which  light  can  be 
coupled  into  all  of  the  fibers.  Polishing  of  the  ends  of  the  fiber  bundles  is  a  critical  step  in  achieving 
uniformity. 

In  the  particular  system  that  was  built,  the  rms  error  of  the  stored  weights  was  measured  to  be  E.5%.  We 
believe  that  this  number  can  be  significantly  improved  by  better  polishing  of  the  ends  of  the  fiber  bundles. 

Analysis  of  Performance  Limits 


An  extensive  analysis  of  the  performance  limits  of  incoherent  optical  matrix-vector  multipliers  has  been 
performed  and  will  be  published  as  a  technical  report  in  the  near  future.  Here  we  can  only  sketch  the 
approaches  taken  and  the  results  obtained. 

The  nonlinearities  of  the  systems  considered  reside  primarily  in  the  LED  drivers.  Both  the  LED's  them¬ 
selves  and  the  PIN  photodiodes  are  extremely  linear.  Measured  LB)  driver  characteristics  have  been  modeled 
with  a  polynomial  fit,  and  a  theoretical  analysis  of  the  output  errors  for  both  deterministic  and  stochastic 
inputs  has  been  performed. 

The  nonlinear  distortions  present  in  the  Output  are,  of  course,  a  function  of  how  hard  the  input  electronics 
are  driven.  The  level  of  the  input  excursions  influences  the  levels  of  the  measured  output  excursions,  which, 
in  turn,  influence  the  signal-to-nois*  ratio  achieved  at  the  output.  The  chief  source  of  noise,  in  this 
regard,  is  thermal  noise  originating  in  the  detector  pre-amplifiers.  Thus,  there  is  a  direct  tradeoff  between 
linearity  and  slgnal-to-nolse  ratio  at  the  output. 

Our  analysis  indicates  that  the  planar  waveguide  realization  is  capable  of  achieving  a  S/N  of  32.3  db  at 
a  level  of  total  harmonic  distortion  (power)  (THD)  of  0.06Z  (32.2  db).  With  the  use  of  more  powerful 
(commercially  available)  LED's,  we  project  that  a  S/N  better  than  52  db  can  be  achieved  with  a  similar  level 
of  THD.  Of  course,  S/N  and  THD  can  be  traded  off  against  one  another  to  some  extent,  if  desired. 

A  second  serious  limitation  to  system  accuracy  arises  from  errors  in  the  optical  weights  achieved  to 
represent  the  matrix.  In  this  regard,  it  is  possible  to  define  a  merit  factor  (MF)  associated  with  the  mask 
as 


MF 


10  lo  Total  av.  ideal  output  power 
*10  Total  ave.  error  power 


(10) 


For  the  "ideal"  mask  used  Initially  in  the  planar  waveguide  realization,  the  value  of  the  merit  factor  is  26  db. 
Ue  anticipate  that  Iteration  of  the  mask  will  increase  the  value  of  the  merit  factor  to  about  40  db. 


We  should  emphasize  that  the  anticipated  performance  levels  in  our  system  are  not  necessarily  the  ultimate 
limit.  An  industrial  organization  with  greater  resources  in  terms  of  money  and  equipment  could  no  doubt 
achieve  performance  specifications  significantly  better  than  we  are  quoting  here. 


Applications 


The  problems  to  which  a  matrix-vector  multiplier  such  as  we  have  described  might  be  applied  are  strongly 
Influenced  by  the  number  of  channels  and  per-channel  bandwidths  that  can  ultimately  be  realized.  Optical 
components  capable  of  150  MHz  bandwidth  are  available  on  an  off  the  shelf  basis.  The  use  of  lasing  diodes 
with  even  GHz  bandwidths  can  be  envisioned,  but  at  a  substantial  Increase  in  cost.  The  complexity  of  the 
operations  that  can  be  performed  is  limited  primarily  by  the  number  of  parallel  input  channels  that  one  can 
build . 


A  processor  having  100  channels,  each  with  100  MHz  of  bandwidth,  would  be  capable  of  a  throughput  rate  of 
5*109  complex  data  samples  per  second.  Such  a  system  might  find  useful  application  in  parallel  beamforming 
for  antenna  arrays,  high  speed  pattern  classification  by  the  nearest  neighbor  rule,  or  in  the  performance  of 
very  rapid  coordinate  transformations. 


120 


We  would  mention  that  che  rapidly  evolving  optical  communication  technology  will  have  a  direct  impacc  on 
cost  and  performance  capabilities.  In  addition,  the  development  of  very  high  speed  integrated  circuits 
will  surely  impact  our  ability  to  build  large  numbers  of  high-speed  input  and  output  channels.  Lastly,  we 
mention  chat  this  type  of  system  can  be  combined  with  CCD  devices  or  SAW  devices  in  a  corner-turning  archi¬ 
tecture,  as  shown  in  Figure  13,  to  perform  two-dimensional  discrete  Fourier  transforms,  or  equivalently, 
products  of  input  macrices  (entered  column  by  column)  with  stored  separable  2-D  matrix  transformations. 
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Figure  1.  Basic  Configuration  of  Incoherent  Matrix-Vector  Multiplier. 
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Figure  2.  Optical  System  for  Performing  Matrix-Vector  Products. 
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Discussion  (Joseph  W.  Goodman;  Discussion  Leader:  Thomas  K.  Gaylord) 


Q.  You  poinced  ouC  Che  equivalence  between  matrix-vector  multiplication  and  1-D  space  variant  operations. 

Of  course  it  is  Che  difference  between  discrete  and  incoherent,  typically,  and  continuoua  and  coherent.  In 
terms  of  John  Ualkup's  talk,  do  you  see  these  two  different  ways  as  competing  or  complementary? 

A.  They're  complementary  in  the  sense  that  we  first  concsived  of  this'  system  after  thinking  about  space 
variant  systems  much  as  what  John  described.  I  think  there  is  a  fundamental  difference  between  the  two  in 
chat  here  we  are  crying  to  emphasise  a  massive  parallelism  in  input  and  output  and  get  away  from  serial  chan¬ 
nels.  In  more  conventional  coherent  opcical  systems  you  have  serial  channels,  for  example  acousto-optic 
inputs.  Thus  I  see  the  approaches  as  complementary,  not  competing. 

Q.  It  seems  you  have  a  trade-off,  you  have  to  produce  n  x  n  sources.  Hill  the  price  always  be  high? 

A.  For  n  x  n  operations,  I  need  n  sources.  Thera  are  two  aspects  to  the  price  question.  One  is  the  elec¬ 

tronics  and  the  other  is  Che  sources  chemselvea.  These  sources  have  a  10  !fflz  bandwidth,  1  mw  per  source, 
and  cost  about  $20  for  quantities  of  one.  If  you  want  to  go  to  higher  power,  10  to  20  mw.  LED's,  the  price 
escalates  quite  a  bit,  you'll  pay  about  10  cists  as  much  par  source.  The  electronics  associated  with  a 
channel  in  the  10  MHz  regime  is  noc  really  difficult.  I  know  one  could  build  a  100  MHz  per  channel  system, 
but  I  don't  know  what  the  cost  would  be.  As  to  ,ne  future,  someone  made  Che  statement  earlier  that  whatever 

happens  to  coherent  light  valves  depends  on  «nat  happens  in  display  projection.  That  is,  display  projection 

is  Che  financially  attractive  application  of  these  devices  that  motivates  people  to  develop  them.  I  would 
respond  in  the  same  way  chat  fiber  optica  cosanm lea cions  systems  is  a  big  and  growing  business,  and  I'm  fair¬ 
ly  optimistic  thac  with  time  there  will  be  a  downward  trend  in  the  cost  of  these  sources  and  an  upward  trend 
in  cheir  capabilities.  Already  the  Japanese  have  reported  the  integration  of  a  number  of  avalanche  photo¬ 
diodes  on  a  single  substrate. 

C.  Maybe  a  flgure-of-merlt  la  something  like  dollars  per  space-bandwidth  product. 

R.  I  think  one  needs  dynamic  range  in  there  Coo,  to  make  it  a  little  more  complicated.  It  is  a  difficult 

question  Co  arrive  at  a  f lgure-of-merlt. 

Q.  In  your  future  directions  you  mentioned  the  idea  of  generating  masks  by  E-beam  techniques.  Do  you  mean 
photographic  techniques  or  using  an  E-beam  spatial  light  modulator? 

A.  I  was  chinking  of  E-beam  systems  chat  write  directly  on  photographic  film  in  nanoseconds  with  micron 
accuracy.  I  chink  one  could  cake  advantage  of  that  technology  if  one  wants  to  control  the  weights  very  accur¬ 
ately  in  a  repeatable  way.  But  you  open  a  whole  new  aspect  of  this  which  I  forgot  to  mention.  You  could 
conceivably  make  che  matrix  mask  a  light  valve  and  change  it  dynamically  in  time,  which  might  make  for  some 
very  interesting  applications. 

Q.  Is  there  any  application  for  which  you  need  real  time  and  update  in  real  time  capability? 

A.  I  Chink  so,  probably  in  che  area  of  adaptive  arrays,  you  can  do  beam  forming  with  a  system  like  this. 

C.  You  mentioned  thac  one  version  of  the  system  has  the  input  amplitude  modulated  on  a  carrier  to  reduce 

distortion.  I  wonder  if  you  could  eliminate  the  two  channels  and  get  around  the  positive-negative  problems 
if  you  modulated  in  amplitude  and  phase,  assuming  you  could  build  a  complex  mask. 

R.  I  haven't  been  able  to  find  a  way  to  do  thac,  and  the  reason  is  thac  I  can't  modulate  the  mask.  If  you 
use  a  modulation  with  che  real  and  imaginary  parts  of  the  signal  representing  the  real  and  imaginary  vector 
components,  at  the  end  you  have  to  be  able  to  extract  che  inner  product  of  the  real  part  with  its  appropriate 
part  of  che  mask  and  the  inner  product  of  che  Imaginary  part  with  its  appropriate  part  of  che  mask.  I  see  no 
way  to  sort  chose  out  unless  one  somehow  tags  them  as  they  go  through  the  mask.  By  amplitude  modulating  che 
signal  you  gain  dynamic  range,  but  by  introducing  more  complex  modulation  I  don't  see  chat  you  buy  anything 
more  unless  you  can  modulate  the  mask. 

q.  How  large  an  array  can  you  realistically  imagine?  You  had  10  elements  here. 

A.  I  feel  secure  in  saying  chat  one  could  build  a  100  element  array.  Someone  told  me  he  has  a  1024  element 
array,  but  it  doesn't  have  a  10  MHz  bandwidth  per  channel.  I  don't  think  che  device  technology  of  making 
large  arrays  is  che  real  thing  chat  frightens  me  about  a  large  number  of  channels,  it  is  the  parallel  elec¬ 
tronics. 

C.  You  might  use  polarized  light  to  get  your  bipolar  range,  where  you  have  two  polarizations  and  one  acts 
as  a  reference  phase  for  Che  ocher. 

R.  That  might  work,  we  really  haven' t  thought  much  about  using  polarizers  to  do  that. 

q.  Earlier  Or.  Lee  showed  us  a  device  which  was  completely  planar  and  consisted  of  sources,  detectors,  and 
a  signal  processor.  My  question  is,  which  is  best,  a  3-0  processor  or  a  2-0  processor?  You  gain  in  simpli¬ 
city  with  2-D  but  you  pay  a  price  in  throughput  rate  since  you  must  wait  for  two  waves  to  propagate  past  one 
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another.  In  easence,  you  are  putting  one  dimension  of  the  weights  into  time  and  the  other  dimension  of  the 
weights  is  fixed.  I  find  it  very  appealing  to  make  a  3-D  system  and  not  be  constrained  to  a  plane. 

A.  I  concur  with  your  analysis,  and  I  think  there's  applications  for  both  of  them,  depending  on  the  system. 
In  the  2-D  case,  you  get  a  very  nice  match  between  CCD's  at  the  input  to  parallel  channels,  the  SAW  device, 
and  the  A-0  interaction.  You  can  get  several  orders  of  magnitude  increase  in  throughput  by  making  the  chirp 
Z-transform  SAW's  and  then  having  this  3-D  parallel  device.  It  is  a  question  of  whether  you  have  an  appli¬ 
cation  that  needs  2  or  3  orders  of  magnitude  increased  throughput.  I  think  they  are  complementary. 

C.  If  you  are  looking  for  applications,  people  have  talked  about  imaging  Fourier  transform  spectrometers. 

If  you  had  a  spectrometer  with  1000  x  1000  spatial  elements,  and  if  you  wanted  to  look  at  the  spectrum  at 
those  million  points  10  times  a  second,  then  you  are  about  to  get  up  into  this  type  of  throughput.  It  is 
hard  to  think  up  a  technique  that  would  be  relatively  broadband  and  extract  that  much  information  from  a 
scene  by  any  other  method  than  an  imaging  Fourier  transform  spectrometer,  because  filters  tend  to  have 
variable  fields  of  view  and  may  not  have  the  spectral  bandwidth  that  you  would  like. 
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Introduction 


The  purpose  of  this  paper  is  to  try  and  predict  or  suggest  the  future  direction  of  digital  optics.  In 
order  to  accomplish  this  the  state-of-the-art  will  be  briefly  reviewed.  The  advantages  and  disadvantages  of 
optics  will  then  be  discussed  in  an  abstract  manner.  Some  possible  applications  matched  with  these  capabil¬ 
ities  will  then  be  examined.  An  example  of  a  simple  optical  digital  computer  will  then  be  presented  to 
demonstrate  some  of  the  techniques,  problems,  and  possiblities  of  using  digital  optics. 

The  State-of-th e-Art  of  Digital  Optics 

Current  efforts  in  the  area  of  digital  optics  are  centered  around  optical  memories,  logic  devices,  and 
methods  of  performing  arithmetic. 

Optical  Memories 

There  has  been  a  resurgence  of  interest  in  read  only  and  read-write  memories  based  on  video  disk  tech¬ 
nology.  The  effort  has  been  led  by  same  large  companies  such  as  IBM,  CDC,  and  Honeywell.  The  projected 
application  for  such  memories  involve  magnetic  tape  replacements  and  large  data  base  storage. 

Optical  Logic 

One  approach  towards  optical  logic  involves  laser  diodes  iBASI.  Unfortunately,  it  was  difficult  to 
demonstrate  any  advantage  of  this  technology  over  comparable  electronic  approaches  fLANl .  This  early  work 
is  being  closely  reconsidered  by  the  integrated  optics  community.  The  pish  by  optical  communications  has 
prompted  the  development  of  several  devices  capable  of  performing  digital  operations.  Controllable 
waveguide  couplers  are  one  such  device.  They  have  been  used  for  logic  and  simple  A/D  units  hy  Taylor  fTAYl . 
Another  such  device  is  the  integrated  optic  versions  of  Fabry-Perot  interferometers  which  are  fast  and 
require  very  little  energy  to  latch  rGAPl .  Vhile  many  novel  devices  have  been  demonstrated  integrated 
optics  is  still  haunted  by  the  capabilities  of  electronic  GaAs  devices.  The  viability  of  integrated  optics 
will  depend  heavily  on  whether  it  can  ultilize  some  of  advantage  of  optics  other  than  just  bandwidth. 

The  incremental  punping  of  a  laser  cavity  can  also  be  used  to  perform  logic.  IBM  has  some  of  the  early 
patents  in  this  area.  The  problem  with  laser  logic  involves  the  energy,  hardware,  and  cycle  time  required 
by  this  approach.  A  new  approach  using  dyes  has  been  suggested  by  Johnson  TJOHl .  A  similar  approach  is 
currently  being  pursued  as  a  means  of  achieving  sub-picosecond  switching  times. 

Logic  operation  can  also  be  performed  by  interfering  the  outputs  of  a  properly  programmed  holographic 
associative  memory.  This  holographic  approach  to  logic  is  being  pursued  by  Guest  and  Gaylord  (Georgia  Tech) 
fGUEl.  This  approach  is  capable  of  performing  simple  Boolean  operations  by  table  lookup.  It  can  be 
extended  to  perform  simple  combinatoric  logic  In  a  manner  similar  to  a  programahle  logic  array.  This  can  be 
taken  one  step  further.  The  basic  table  lookup  mechanism  can  also  perform  some  types  of  arithmetic  with 
little  more  complexity  than  the  orginal  Boolean  operations.  Similar  work  is  mentioned  by  Mnatsakanyan 

rMNAl . 


Another  approach  towards  digital  logic  relies  on  controllable  transparencies.  This  approach  involves 
mating  intearated  circuits  technology  ahd  optics.  The  basic  mechanism  involves  using  an  array  of  photocon¬ 
ductors  each  modulating  the  transparency  of  a  separate  liquid  crystal  cell.  Such  work  is  being  done  by  Lee 
CJ.C.S.D)  rLEE]  and  Orlov  r0RL] .  The  object  is  to  produce  arrays  capable  of  performing  loqic  operations.  A 
first  binary  image  would  activate  the  photoconductor  and  thus  control  the  liquid  crystal  cell.  These  cells 
would  then  interact  with  a  second  binary  image. 

Spatial  modulators  such  as  the  Huohes  liauid  crystal  light  valve  and  the  ITEK  prom  can  also  perform 
logic  operations  in  an  array  like  tanner.  Collins  (Ohio  State)  has  used  a  light  valve  with  feedback  to 
implement  optical  flip-flops  and  other  logic  operations  fC0L2) .  Strand  (U.S.C.)  has  used  a  light  valve  in  a 
variable  arating  mode  to  achieve  A/D  conversion  along  with  various  logic  functions  (STR) .  Hudgins 
(ITEK) (MIS'  and  Cindrich  (EBIM)  have  respectively  mentioned  that  similar  operations  are  possible  with  the 
ITEK  prom  and  photo-elastomers.  What  is  so  intriging  about  these  approaches  is  that  they  achieve  logic 
operations  in  hulk.  Thousands  of  operations  are  just  as  complex  as  a  single  operation.  One  drawback  is 
that  these  mechanisms  are  relatively  slow.  However,  It  must  be  remembered  that  these  devices  were  orginally 
developed  for  'Ynamtc  ranne  rather  than  speed.  It  seems  reasonable  to  assume  that  faster  non-linear  mechan¬ 
isms  are  possible. 
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Logic  arrays  seen  to  he  a  cormon  goal  for  researchers  involved  with  holographic  logic,  controlled  tran¬ 
sparencies,  and  spatial  light  modulators.  One  reason  for  this  is  that  it  ultilizes  the  parallelism  of 
optics.  The  question  of  how  to  use  these  devices  still  remains,  A  clue  to  this  can  be  foun-*  in  the  TPE 
computer  suggested  by  Schaefer  fsCHl.  This  is  a  two  dimensional  computer  intended  for  processing  images. 
While  the  implementation  is  a  little  awkward  the  basic  idea  of  processina  imaoes  with  Boolean  logic  arrays 
is  quite  interesting. 

Optical  Arithmetic 

It  is  also  possible  to  perform  arithmetic  directly  and  bypass  the  necessity  of  implementing  Boolean 
operators.  The  idea  was  initally  suggested  by  Basov  fBASt.  This  led  to  the  work  by  Huang  (HUAI] .  This 
work  has  since  been  continued  by  Huang  fHUA21 ,  Collins  TCOLll,  Stoner  TSTOl ,  and  Ciridrich  1CIN] .  Collins 
impressed  the  cyclic  nature  of  the  residue  nun  be r  system  on  the  cyclic  nature  of  polarization.  Cindrich 
proposes  impressing  the  residue  nunber  system  on  the  spatial  domain  using  integrated  optical  waveguide 
couplers. 

Another  approach  towards  performing  arithmetic  directly  involves  the  use  of  optical  convolution  to  per¬ 
form  multiplication.  This  has  been  suggested  by  Whitehouse  (NEL)  and  Casasent  (Cameqie-Mellon)  fCASl . 

The  Advantages  of  Optics 


Massive  Parallelism 

Lenses,  mirrors,  prisms,  etc.  can  easily  handle,  with  their  inate  parallelism,  millions  of  resolvable 
points  at  the  same  time.  The  difficulty  is  how  to  use  this  parallelism.  Part  of  the  problem  is  conceptual. 

We  think  sequentially  and  thus  it  is  hard  to  apply  this  parallelism.  Another  part  of  the  problem  is  that 
such  a  system  must  be  almost  completely  optical  since  any  electrical  interface  will  place  a  practical  limit 
on  the  amount  of  parallelism  which  can  be  achieved.  A  hundred  optical  channels  implies  a  hundred  sources 
and  detectors. 

Mon-Planar  Propagation 

Optical  signals  can  pass  through  each  other  without  interference.  This  is  unique.  Electrical  signals 
have  to  be  guided  by  wires  and  guarded  from  interacting  with  other  electrical  signals.  The  problem  is:  v*iy 
use  optics  vtien  wires  are  so  cheap?  Advances  in  computers  are  quickly  changing  this.  Speed  requirements 
force  interconnections  to  be  short  (less  than  fi  inches)  and  of  very  large  bandwidths  (10  ghz) .  A  large  por¬ 
tion  of  a  high  speed  machine  such  as  the  CRAY-1  or  AMDAHL  470  is  devoted  to  coaxial  cables  and  terminating 
resistors.  The  main  problem  is  now  one  of  communications  rather  than  switching  speed.  This  provides  a  rea¬ 
son  for  using  optics.  The  question  remains  how?  If  each  signal  requires  a  source  and  detector,  the  elec¬ 
tronics  overhead  would  limit  the  practicality  of  any  such  approach. 

Disadvantages  of  Optics 

Detection  and  Restlmulatlon 

It  is  very  difficult  to  g^‘-  one  optical  signal  to  affect  another  optical  signal.  Typically  to  achieve 
this,  the  optical  signals  must  be  detected  and  the  result  restlmulated.  This  involves  time  and  hardware. 
The  electronics  required  makes  this  process  highly  questionable.  If  a  pn  junction  is  used  to  detect  the 
light  and  a  pn  junction  is  used  to  generate  the  light,  why  use  light  in  the  first  place. 

The  time  it  takes  for  detection  and  restimulation  is  especially  crucial  in  a  conventional  sequential 
*  computer.  New  pipelined  architectures  have  changed  this.  The  detection  and  resimulation  overhead  can  be 

absorbed  by  the  pipeline.  The  quest  is  now  for  throughput  rather  than  just  speed.  The  question  becomes  how 
many  defections  and  restimulations  can  be  accomplished  in  parallel? 

Optical  Logic 

Many  schemes  have  been  explored  to  implement  optical  logic.  The  difficulties  are  in  speed  end  inter¬ 
facing.  Pipelining  has  altered  some  of  the  constraints  on  optical  logic.  Parallelism  can  be  used  to  ccm- 
>  pensate  for  speed.  The  interfacing  problem  is  a  restatement  of  the  detection  and  restimulation  problem. 

The  output  of  most  optical  logic  has  to  be  detected  and  then  restimulated  to  produce  another  optical  signal. 
This  increases  the  complexity  and  limits  the  speed.  The  interfacing  must  be  minimized  or  else  the  required 
electronics  will  squelch  the  parallelism  *#iich  can  be  achieved  hy  the  optics. 

Appropriate  Technology 

When  is  it  proper  to  use  electronics  and  vrtien  optics? 

Then  is  a  reciprocal  relationship  between  optics  and  electronics  which  results  from  the  very  nature  of 
electrons  3  and  photons.  It  is  very  easy  for  electrons  to  affect  other  electrons.  As  a  result,  the  interac¬ 
tion  of  electronic  signals  is  easy  but  they  are  awkward  for  communications  since  they  have  to  be  guided  by 
wires  and  shielded  from  other  electrical  signals. 
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On  the  other  hand,  it  is  very  difficult  for  a  photon  to  affect  other  photons.  As  a  result,  optical 
signals  are  good  for  communications  but  awkward  to  interact  with. 

Some  other  guidelines  are  that  optics  should  not  try  to  mimic  electronics  directly.  The  contest 
quickly  becomes  economic.  As  an  example,  logic  using  integrated  optics  might  be  feasible  hut  the  electronic 
version  costs  only  five  cents.  In  order  to  compete,  optics  must  find  some  way  to  ultilize  either  its 
parallelism  or  its  non-planar  propagation  ability.  This  is  very  difficult.  Such  a  system  must  be  almost 
purely  optical  since  any  hybrid  approach  will  suffer  from  the  limitations  of  an  electronics  interface. 

Why  Digital  Optics? 


Now  that  we  have  some  idea  of  the  state-of-the-art  of  digital  optics  and  some  of  the  inherent  advan¬ 
tages  and  disadvantages  of  optics  we  are  faced  with  the  question  of  what  to  do.  Who  needs  the  capabilities 
of  optics? 

One  possible  application  is  computers.  The  reason  for  this  can  best  be  seen  by  studying  some  of  the 
problem  which  limit  the  development  of  future  computers.  Some  of  these  problems  are  clock  skew,  bandwidth, 
interconnections,  and  the  Von  Neumann  bottleneck.  What  these  problems  have  in  common  is  communications. 
The  current  difficulty  is  no  longer  one  of  switching  speed  but  rather  how  to  get  the  right  data  to  the  right 
place  at  the  right  time. 

Clock  Skew 


The  clock  skew  problem  can  be  seen  in  Figure  1.  This  problem  occurs  when  the  switching  time  approaches 
the  propagation  delay.  An  error  will  result  unless  the  different  input  signals  arrive  at  the  gate  simul¬ 
taneously.  This  implies  that  the  path  lengths  of  all  the  inputs  have  to  be  almost  identical.  This  is  par¬ 
ticularly  difficult  for  a  planar  interconnection  technology.  These  difficulties  place  restrictions  on  the 
geometry  of  the  processor.  The  CRAY-1  computer  is  a  good  example  of  this  problem. 

Bandwidth 


Another  hardware  problem  is  one  of  bandwidth.  The  logic  vrtiich  is  used  today  triggers  on  either  the 
rising  or  falling  edge  of  a  signal.  See  Figure  ?.  To  keep  these  edges  sharp  requires  the  preservation  of 
the  higher  harmonics  of  the  signals.  The  propagation  of  a  1  nanosecond  pulse  requires  a  transmission  line 
with  a  bandwidth  much  greater  than  1  ghz.  This  implies  that  most  of  the  off  chip  interconnections  have  to 
be  accomplished  with  terminated  coaxial  lines.  A  large  post ion  of  the  volume  of  current  processors  such  as 
the  AMDAHL  4? 0  are  already  occuppied  in  this  manner. 

Interconnect ions 


Another  area  of  difficult  is  in  the  architecture  of  computers.  Processors  have  traditionally  been 
designed  with  centeralized  control.  As  the  processor  grow  larger  and  faster  the  flow  of  information  becomes 
congested  at  the  centralized  control  point.  In  order  to  relieve  this  problem  the  control  Is  being  distri¬ 
buted.  The  more  it  is  distributed  the  more  coordination  is  needed.  This  requires  more  communication  paths. 
The  nunber  of  interconnections  grows  very  quickly.  N  centers  requires  N(N-l)  bilateral  communications 
paths.  See  Figure  3.  The  typical  approach  around  this  problem  is  to  share  a  high  speed  bus.  This  trades 
time  for  hardware  interconnections.  Unfortunately,  there  is  a  limit  to  this  time  multiplexing.  This  limits 
the  number  and  speed  of  such  centers.  The  alternative  is  to  increase  the  nunber  of  interconnections  but 
this  adds  to  the  complexity  and  control  overhead.  This  inability  to  communicate  limits  the  complexity  which 
can  be  achieved. 

The  Von  Neumann  Bottleneck 


An  even  more  fundamental  problem  is  the  Von  Neunann  bottleneck  fBACl .  The  structure  of  a  conventional 
computer  is  shown  in  Fiaure  4.  The  difficulty  is  that  all  the  instructions  and  data  have  to  travel  between 
the  CPU  and  memory.  This  is  agravated  by  the  fact  that  only  one  item  can  be  handled  at  a  time  and  that  an 
address  is  needed  for  each  item.  Currently  the  majority  of  the  time  required  to  perform  a  particular  compu¬ 
tation  is  involved  in  figuring  out  where  to  get  and  put  the  data.  This  bookkeepina  overhead  and  seauentai- 
ity  are  some  of  the  fundamental  limitations  of  throughput,  why  this  problem  exists  and  how  it  can  be 
avoided  can  best  be  understood  by  reviewing  some  computer  fundamentals. 

A  classical  finite  state  machine  fTORl ,  as  shown  in  Figure  5,  is  the  ancestor  of  all  present  day  com¬ 
puters.  It  consists  of  latches  connected  to  a  combinatoric  logic  unit.  The  latches  preserve  the  outputs  of 
the  combinatoric  circuits  for  one  cycle  such  that  they  can  be  used  as  inputs  on  the  next  cycle.  This  cir¬ 
cuit  is  completely  parallel  and  has  no  Von  Neumann  bottleneck.  There  is  no  worry  about  where  to  get  and  put 
the  information  since  the  interconnections  between  the  latches  and  logic  are  fixed.  The  system  is  also 
parallel  since  all  the  latches  can  be  accessed  independently  at  the  same  time. 

The  trouble  begins  when  more  state  variables  are  needed.  The  number  of  interconnections  between  the 
latches  and  logic  quickly  increase.  A  binary  encoding  technique  is  used  to  reduce  N  interconnections  to 
'logj  N1  interconnections.  This  is  the  source  of  the  Von  Neumann  bottleneck. 
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A  modified  finite  state  machine  is  shown  ir  Fiaure  E.  The  number  of  interconnections  is  greatly 
reduced.  Unfortunately,  the  characteristics  of  the  system  have  also  been  altered.  The  system  is  now 
sequential  rather  than  parallel.  The  addressing  mechanism  can  only  access  one  latch  at  a  time.  It  must 
also  know  which  latch  to  get  from  or  put  to.  Furthermore,  the  characteristics  of  the  latches  themselves 
have  been  altered.  Since  they  are  addressed  in  a  random  manner  the  latches  must  now  hold  their  contents  for 
an  indefinate  amount  of  time.  This  is  in  contrast  with  the  classical  finite  state  machine  (Figure  E)  in 
which  the  latches  need  only  hold  the  information  for  1  cycle. 

The  bottleneck  exists  because  in  electronics,  it  is  more  practical  to  have  flog.  Ml  wires  rather  than  N 
wires.  This  compromise  and  the  resulting  bottleneck  is  also  reflected  in  the  the  address  decoder  of  every 
memory  chip  as  well  as  the  protocols  of  each  bus.  In  order  to  remove  the  Von  Neumann  bottleneck  from  the 
hardware  a  practical  means  of  cormunicating  N  channels  in  parallel  must  be  found.  Given  the  right  condi¬ 
tions,  this  is  quite  simple  for  optics. 

Optical  Memories 

Optical  computers  have  been  suggested  before.  One  of  the  major  drawbacks  was  the  development  of  an 
optical  memory.  The  main  difficulties  are  memory  addressing  and  storage  material.  Unfortunately,  optics 
tried  to  implement  the  the  memory  needed  by  a  modified  finite  state  machine  as  shown  in  Figure  6  rather  than 
the  simpler  memory  needed  by  the  classical  finite  state  naehine  as  shown  in  Figure  5.  The  memory  of  the 
modified  finite  state  machine  has  the  compromises  required  by  an  electronics  technology,  the  Von  Neumann 
bottleneck.  The  potiental  parallelism  of  optics  was  thus  restricted  from  the  onset.  The  addressing  mechan¬ 
ism  was  slow,  awkward,  and  expensive.  Beam  deflectors,  page  composers,  and  detector  arrays  were  needed. 
The  storage  material  was  required  to  store  the  information  indefinitely  rather  than  for  just  one  cycle  as  in 
the  classical  finite  state  machine.  The  search  for  such  a  material  has  proven  to  be  very  difficult. 

An  optical  memory  for  a  classical  finite  state  machine  is  considerablely  simplier  and  ultilizes  more  of 
the  potential  of  optics.  The  storage  medium  in  this  case  need  only  delay  the  information  for  1  cycle.  The 
other  advantage  is  that  no  addressing  mechanism  is  needed  and  thus  the  potiental  parallelism  is  not  res¬ 
tricted. 


A  Proposed  Optical  General  Purpose  Computer 


As  an  example  of  one  of  the  possible  applications  of  digital  optics  a  simple  optical  general  purpose 
computer  is  presented.  It  is  implemented  along  the  lines  of  a  classical  finite  state  machine  as  shown  in 
Figure  5.  The  basic  approach  involves  decomposing  the  structure  of  a  classical  finite  state  machine  into  a 
logic  unit,  an  interconnection  array,  and  a  latching  unit. 

An  Optical  Logic  Array 

Any  digital  circit  can  be  constructed  completely  out  of  NOR  gates.  Some  NOR  gate  equivalents  are  shown 
in  Figure  7.  The  topology  of  a  digital  circuit  can  be  rearranged  to  form  a  column  of  gates  as  shown  in  Fig¬ 
ure  8.  The  interconnections  of  the  gates  can  be  organized  by  conceptually  combing  the  wires  to  confine  the 
interconnections  within  a  given  area  as  shown  in  Figure  9.  This  concept  can  be  extended  into  two  dimen¬ 
sions.  The  result  is  a  combinatoric  logic  unit  comprising  a  NOR  gate  array  and  an  interconnection  array  as 
shown  in  Figure  10. 

An  optical  NOR  gate  array  can  be  constructed  in  the  following  manner.  If  two  or  more  checkerboard 
Images  are  projected  on  a  common  surface  the  resulting  image  will  be  the  OR  of  these  images.  If  this 
resulting  image  is  inverted  in  contrast  and  thresholded  then  the  intensity  of  each  square  of  the  output 
checkerboard  represents  the  NCR  of  the  inputs  of  the  square.  This  is  illustrated  in  Figure  11.  Thus  an 
array  of  NOR  gates  can  be  constructed  with  a  non-linear  contrast  inverting  mechanism. 

Such  a  non-linear  contrast  inverting  device  can  be  implemented  in  several  ways.  A  Hughes  Liquid  Crys- 
tral  Light  Valve  could  be  used  to  achieve  a  cycle  time  in  the  hundreths  of  seconds.  The  ITEK  Optical  FROM 
could  probably  achieve  a  cycle  time  in  the  order  of  milliseconds.  An  array  of  "optical  transistors"  imple¬ 
mented  with  integrated  optics  can  probably  achieve  cycle  times  in  the  order  of  microseconds. 

Interconnection  Array 


The  outputs  of  these  NOR  gates  are  used  as  the  inputs  of  other  NOR  gates.  This  redirection  is  per¬ 
formed  by  the  interconnection  array.  The  output  of  each  square  is  redirected  to  be  the  input  of  other 
squares.  This  operation  can  be  performed  with  a  hologram.  Unfortunately,  the  hologram  for  a  random  inter¬ 
connect  pattern  would  be  quite  difficult  and  quite  specialized.  A  simpler  approach  is  to  customize  a  regu¬ 
lar  interconnection  pattern.  Such  a  regular  interconnection  pattern  is  shown  in  Figure  12.  Each  square 
represents  an  optical  NCR  gate.  The  top  circle  in  each  square  is  the  input  vhile  the  bottom  circle  is  the 
output.  The  output  of  a  NOR  gate  with  a  location  (X,Y1  is  distributed  via  the  latches  to  the  Inputs  of  the 
NOR  gates  at  locations  (X,Y-1),  (X+1,Y-1)  and  (X-2,Y-1).  The  hologram  to  accomplish  this  associates  a 
reference  point  source  (X,Y)  with  three  object  point  sources  located  at  (X,Y-1),  tX+l,Y-l) ,  and  (X-2,Y-1). 
Such  an  optical  distribution  system  would  distribute  the  outputs  of  any  number  of  inputs  in  parallel.  This 
regular  interconnection  can  also  be  accomplished  with  beam  splitters  and  prisms,  however  the  holographic 
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approach  would  have  greater  optical  efficiency. 


To  implement  a  particular  interconnection  pattern  the  regular  interconnection  pattern  must  be  custom¬ 
ized.  This  can  be  accomplished  in  two  ways.  A  mask  as  shown  in  Figure  13  can  be  used  to  block  the  outputs 
from  particular  NOR  gates  before  they  can  be  distributed.  Another  approach  is  to  prevent  particular  NOR 
gates  from  having  any  output  by  forcing  their  inputs  "high*.  This  is  shown  in  Figure  14.  This  last 
approach  is  considerably  more  flexible  since  the  customizing  interconnection  pattern  can  be  accomplished  by 
projecting  a  pattern  on  the  input  of  the  optical  NOR  gate  array. 

Some  examples  of  this  projection  customizing  are  shown  in  Figure  15.  Merges,  forks,  cross  overs,  left, 
right,  and  straight  are  some  of  the  connections  which  are  possible.  These  are  sufficient  to  form  a  complete 
connective  set. 

Optical  Latches 

The  only  requirement  of  the  latches  in  a  classical  finite  state  machine  is  that  they  can  store  the  out¬ 
put  of  the  combinatoric  logic  unit  for  one  cycle.  This  allows  the  output  to  be  used  as  part  of  the  input  of 
the  next  cycle.  In  some  early  prototypes  of  conventional  computers  this  was  accomplished  with  simple  delay 
lines.  The  necessary  amount  of  delay  is  determined  by  the  speed  of  the  logic  unit,  which  in  this  case  Is 
limited  by  the  non-linear  contrast  inverter.  The  overall  structure  is  shown  in  Figure  17. 

If  the  delays  required  are  too  large  to  be  accomplished  by  a  simple  optical  delay  then  a  ring  approach 
as  shown  in  Figure  16  can  be  used.  The  output  of  each  combinational  logic  unit  (interconnection  and  logic 
arrays)  is  used  as  the  input  of  another  such  unit.  N  such  units,  each  providing  a  little  delay,  are 
arranged  in  a  ring.  If  the  ring  is  sufficiently  large  then  each  non-linear  contrast  inverter  will  have  a 
sufficient  time  to  recycle. 

Input  and  Output 

The  basic  hardware  is  determined  by  the  customized  interconnection  pattern.  The  program  or  software  of 
the  system  can  be  Input  as  a  pattern  which  further  customizes  these  interconnections.  The  input  data  can  be 
entered  as  still  another  pattern.  The  output  of  the  system  is  just  a  portion  of  the  outputs  of  the  NOR  gate 
array.  Thus  the  hardware,  software,  data,  and  output  can  all  be  handled  in  parallel. 

Overall  Architecture 

An  example  of  a  section  of  such  a  eieneral  purpose  optical  processor  is  shown  in  Figures  18  through  22. 
Figure  18  shows  the  bias  customizing  pattern.  Figure  19  shows  the  contents  of  the  latch.  Figure  20  shows 
the  OR  of  the  regularly  distributed  latch  contents  and  the  external  inputs.  Figure  21  shows  this  ORed  with 
the  customizing  pattern.  Figure  22  shows  the  result  of  a  NOT  operation  (contrast  inversion  and  threshold¬ 
ing)  on  this  array.  This  result  is  latched  and  used  as  the  input  of  the  next  cycle. 

On  each  new  cycle  the  signals  propagate  to  a  new  row.  The  first  row  accepts  a  new  set  of  signals  on 
each  new  cycle.  The  system  is  naturally  pipelined.  If  there  are  N  rows  then  N  sets  of  signals  are  In  par¬ 
tial  states  of  processing  at  any  given  time.  This  pipelining  facilitates  very  large  throughputs. 

Other  Computational  Structures 

The  signals  in  the  simulation  shown  in  Figures  18  -  22  propagate  through  the  system  much  like  "optical 
bubbles".  A  25  by  25  array  of  optical  NOR  gates  can  be  used  as  a  shift  register  if  interconnect  patterns  of 
(X,Y)  ->  (X+1,Y)  and  (X,Y)  ->  fX-24,Y-l)  are  used.  As  another  example,  interconnection  patterns  of  (X,Y)  -> 
(X+1,Y)  and  (X,Y)  ->  (X-24,Y-8)  will  produce  a  "’S  element  8  bit  wide  shift  register. 

The  formalism  of  a  classical  finite  state  machine  can  also  support  non-8oolean  based  computing  struc¬ 
tures.  Oie  example  is  a  number  theoretic  processor THUA3] .  Another  example  is  the  customizing  pattern  shown 
In  Figure  18.  This  pattern  implements  an  "Amida  Kuzi"  interconnection  network  THUA21  as  shown  in  Figure 
23.  This  network  is  one  of  the  basic  buildina  blocks  of  a  number  theoretic  processor  pipelined  by  moduli. 

New  computer  architectures  which  better  ultilize  the  parallelism  of  these  processors  should  be 
explored.  Current  computers  are  designed  around  the  Von  Neumann  bottleneck.  Duplicatina  these  machines 
would  just  perpetuate  this  bottleneck.  Expressed  in  other  words  the  difficulty  is  finding  problems  with  a 
sufficient  amount  of  parallelism  to  exploit.  One  possibility  is  the  processing  of  images  with  the  two 
dimensional  architecture  simiar  to  the  TSE  computer  rSCHl. 

Summary  of  the  Proposed  Optical  Digital  Computer 

The  proposed  general  purpose  optical  computer  is  very  simple.  It  consists  of  a  logic  array,  an  inter¬ 
connection  array,  and  a  delay.  The  system  is  designed  to  exploit  the  parallelism  of  optics  and  non-planar 
propagation.  The  fabrication  is  simplified  since  the  wiring  is  replaced  with  a  customized  regular  intercon¬ 
nection  pattern.  The  packing  density  of  optical  NOR  gates  should  be  greater  since  each  optical  NOR  gate  is 
simpler  and  needs  no  planar  Interconnections.  The  communications  paths  are  non-planar,  parallel,  high 
bandwidth,  and  need  no  termination.  The  only  detection  and  restimulation  occurs  within  the  non-linear 
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contrast  inverting  device.  The  inputs  ant^  outputs  are  parallel  and  can  support  very  large  throughputs.  The 
system  is  also  naturally  pipelined. 

The  practical  limits  on  the  array  size  and  cycle  times  have  yet  to  be  determined.  The  throughput  of 
this  proposed  general  purpose  optical  computer  is  the  product  of  the  number  of  optical  NOR  gates  in  the 
array  times  the  cycle  time  of  the  non-linear  contrast  inverting  mechanism.  A  system  with  200, OOP  NOR  gates 
and  a  cycle  time  of  1/100  of  a  second  would  produce  a  throughput  of  20  million  bits  per  second  which  is  com¬ 
parable  with  conventional  computers. 

Discussion 


The  diverse  nature  of  the  state-of-the-art  of  digitial  optics  demonstrates  that  many  optical  phenomena 
can  be  used  to  perform  digital  operations.  These  devices  will  remain  just  curiosities  unless  they  can  ful¬ 
fill  some  some  basic  need.  Mimicing  electronics  is  not  enough.  It  is  crucial  for  these  devices  to  use  some 
of  the  unique  advantages  of  optics  such  as  its  parallelism  or  non-interfering  propagation.  This  is  not  a 
easy  thing  to  do  since  any  interface  with  electronics  will  squelch  the  parallelism  of  optics. 

A  simple  optical  digital  computer  is  presented.  The  architecture  is  unusual  in  that  it  is  fully  paral¬ 
lel.  This  gives  optics  and  advantage  since  it  would  be  very  difficult  to  implement  such  a  processor  with 
electronics.  The  computer  consists  of  a  NOR  gate  array,  a  latching  mechanism,  and  an  interconnect  array. 
Each  of  these  sections  is  conceptually  quite  simple  and  can  be  implemented  by  many  types  of  optical  devices. 
The  intent  of  presenting  this  processor  is  to  start  people  thinking  fcy  demonstrating  some  of  the  techniques, 
problems,  and  possibilities  of  using  digital  optics. 


Acknowleqement 

This  work  was  supported  by  the  Air  Force  Office  of  Scientific  Research  under  grant  AFOSR-77-3219. 


References 


[BAC1  John  Backus,  "Can  Programing  Be  Liberated  From  the  Von  Neumann  Style?  A  Functional  Style  and  Its 
Alqebra  of  Proqrams",  Communications  of  the  Association  of  Caiputinq  Machinery,  vol.  21,  pp.  613- 
641,  August  1978.  - 

[BAS]  N.G.  Basov,  W.H.  Culver,  and  B.  Shah,  "Applications  of  Lasers  to  Computers" ,  laser  Handbook,  edited 
by  F.T.  Arecchi  and  E.O  Schulz-Dubois,  North-Holland  Publ .  Co.,  1972. 

[CAS]  D.  Casasent,  D.  Psaltls,  and  D.  Neft,  "Digital  Multiplication  and  Addition  by  Optical  Convolution", 
Proceedings  of  the  1980  International  Optical  Computing  Conference,  vol.  232,  SPIE,  Bellingham, 
Wash.  April  l5B0. 

[CIN]  I.  Cinderich,  A.  Tai,  J.  Flenup,  and  C.  Aleksoff,  "Proceedings  of  Optical  Processing  Systems",  SPIE 
vol.  185,  Bellingham,  Wash. ,  1979,  p.  2. 

[COL1]  S.  Collins,  J.  Mckay,  and  C.  Vick,  Digest  of  Papers  of  Compcon  Spring  78,  IEEE  Comp.  Soc. ,  San  Fran¬ 
cisco,  IEEE,  1978,  p.198. 

[COL2]  S.  Collins  and  M.  Fatebi,  "Optical  Logic  Gates  Using  a  Hughes  Liquid  Crystal  Light  Valve",  Proceed¬ 
ings  of  the  1980  International  Optical  Computing  Conference,  vol.  232,  SPIE,  Bellingham,  Wash.  April 

[GAR]  E.  Garmire,  J.  Marburger,  and  S.  Allen,  "Incoherent  Mirrorless  Bistabel  Optical  Optical  Devices", 
Applied  Physics  Letters,  vol.  32,  p.  320,  March  1978. 

[GUE]  C.  Guest  and  T  Gaylo-  i,  "Parallel  Truth-Table  Lookup  Digital  Holographic  Processing",  Proceedings  of 
the  1980  International  Optical  Computing  Conference,  vol.  232,  SPIE,  Bellingham,  Wash.  April  1980. 

[HUAI]  A.  Huang,  "Implementation  of  a  Residue  Arithmetic  Unit  Via  Optical  and  Other  Physical  Phenomena", 
Proceedings  of  the  International  Optical  Computing  Conference,  April  1975,  Washington  D.  C.,  IEEE 
Cat.  no.  75  CH0941-5  C. 

{HUA2]  A.  Hang,  Y.Tsunoda,  J.W.  Goodman,  and  S.  Ishlhara,  "Optical  Computation  Using  Residue  Arithmetic", 
Applied  Optica,  vol.  18,  no.  2,  pp.  149-162,  January  1979. 

[HVA31  A.  Huano  „.x;  J  ’•/.  Goortnan,  "Number  Theoretic  Processors,  Optical  and  Electronic",  Optical  Processing 
Svstww,  SP~t  Vol.  185,  May  1979.  “* 

rJ0i  ,  E.  JoV.-r.,  Rlset*  ,,  A.  Lamplckl,  and  H.  Same  Ison,  Applied  Physics  Letters,  vo.  26,  p.  444, 
1975 


134 


V 


CLAN)  R.  Landuaer,  Optical  Information  Processing,  vol.  1,  (Proc.  of  US-USSR  Seminar,  Washington,  D.C., 
1975,  ed  by  Nesterikhin,  Stroke,  and  Kock) ,  Plenum  Press,  N.Y.,  1976,  p.219. 

(LEE]  S.  H.  Lee,  Optical  Information  Processing,  vol.  2,  (Proc.  US-USSR  Seminar,  Novosibirsk,  1976,  ed. 
Barrakette,  Stroke,  Nesterikhin,  and  Kock),  Plenum  Press,  N.Y.,  1978,  p.  171. 

[mna)  E.  Mnatsakanyan,  V.  Morozov,  and  Y.  Popov,  ’Digital  Data  Processing  in  Optoelectronic  Devices 
(Review) *,  Sov.  J.  Quantum  Electron. ,  £(6) ,  June  1979,  (transated  by  American  Institute  of  Physics) . 

[NIS]  P.  Nisenson  and  S.  Iwasa,  "Real  Time  Optical  Processing  with  Bl,„SiO„„  PROM",  Applied  Optics,  Vol. 
11,  No.  12,  Dec  1972,  p.  2^60. 

[0RL1  L.  A.  Orlov  and  Y.  M.  Popov,  Sov.  J.  Quantum  Eectron.,  vol.  4,  12,  1974,  (translated  by  the  American 
Institute  of  Physics) .  ~ 

[SCH1  D.  Schaefer  and  J.  Strong,  "TSE  Computers’,  Proceedings  of  the  IEEE,  Vol.  65,  No.  1,  January  1977, 
p.  129. 

fSTO]  F.  Horrigan  and  W.  Stoner,  ’Residue-based  Optical  Processors’,  ’Proceedings  of  Optical  Processing 
Systems’,  SPIE  vol.  185,  Bellingham,  wash.,  1979,  p.  19. 

[STR1  T.  Strand,  A.  Tanguay,  A.  Sawchuck,  P.  Chavel,  D.  Boswell,  A.  Lackner,  and  B.  Softer,  "Optical  Com¬ 
puting  with  Variable  Grating  Mode  Liquid  Crystal  Light  Valve’,  Proceedings  of  the  1980  International 
Optical  Computing  Conference,  vol.  232,  SPIE,  Bellingham,  wash.  April  1$$6. 

[TAY1  H.  Taylor,  Applied  Optics,  vol.  17,  p.  1493,  1978. 

[TORI  H.C.  Torng ,  Introduction  to  the  Logical  Design  of  Switching  Systems,  pp.  180-196,  Addlson-Wesley, 
1966. 


135 


c 


BANDWIDTH 


LLU'-N  JNL* 


HARMONICS  »  1  Ghz 


1  ns 


Figure  1  C’ocl:  Skew  Problem 


Figure  2  Bandwidth  Problem 


INTERCONNECTIONS 

u2  r/HMtrr 


VON  NEUMANN  BOTTLENECK 


Figure  4  A  Von  Neumann  Computer 


Figure  5  A  Classical  Finite  State  Machine 


Figure  &  A  Modified  Finite  State  N  nine 


Regular  interconnect  ions 


REGULAR  INTERCONNECTION  HOLOGRAK 


(X.Y) 


•  0-20-1', 

[  ,  •  00-1) 

\\  •  0-2, M 


Figure  12  A  Regular  Interconnection  Hologram 


Figure  12  Regular  Interconnection  Pattern 


MASK  CUSTOMIZING 


BIAS  CUSTOMIZED 


NOR  CATE  ARRAT 


Figure  13  flask  Customizing 


/-□ a  0  \ 

^  1 

(MIC  MUt-  I  | 


\  0  B  Q-vl 

Figure  16  Ring  Delay  for  Latching 


Z7 


CUSTOMIZING  PATTERN 


Figure  14  Bias  Customizing 


SICAl -EWTt  STATE  mCNlKt 
LATCH 

/LCHS  /  Oft  DELAY  \f 

A'  m  a  vi 


<0=  <5= 


=>  => 


IHTMCOWtCT  MMT 


f  \  \ 

''  L0S1C  >  . 


- rs  LOSIC  N 

eusTcmrnu  "»»  rofiStc  army 

PATTERN  AND  ^  W 

INPUTS 


Figure  17  An  Optical  Finite  State  Machine 


V 


□"  Q"  □ 


□  E 


LOT 


FT  □  □ 


m  □ 


OIOSS 


n]  n 

✓  * 

□""□  \h  'm 


o  1  TRUE 
•  S  FALSE 


Figure  15  Examples  of  Projection  Customizing 


•  DATA  DCfOMBT 
Qwt  CMC 


BIAS  CUSTOMIZING  PATTERN 


1111100111100111111111 
11  1  1  0  0  l  l  1  1  0  0  1  1  t  1  1  1  1  1  l  1 
i  i  i  i  o i o  i  i  ro l o  i  i  i  i  i  i  i  i  i 
1111100111100111111111 
1110111011101011111111 
1111011100111101111111 
1101111001110111111111 
1110111010111011111111 
1110111100111101111111 
1111010111011101111111 
1111100111100111111111 
1111001111001111111111 
1111010111010111111111 
lltllOOllllOOllltlllll 
1110111011101011111111 
1111011100111101111111 
1101111001110111111111 
1110111010111011111111 
lllOllilOOllllOlllllll 
1111010111011101111111 
1111100111100111111111 
1  1  I  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  l  1  l 
1111111111111111111111 
1111111111111111111111 
1  I  I  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1 
SECTOR  HOSE  HAS*  CTCU  -  1 


Figure  18  31as  Customizing  Pattern 


CONTENTS  OF  THE  LATCH 


0  0 

0 

0 

0 

l 

0 

0 

0 

0 

0  0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

1 

0 

0 

0 

0 

0 

1  1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0.0 

0 

0 

0 

0 

1 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

1 

0 

0 

0 

0. 

0  1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

t 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

1 

0 

0 

0 

0 

1 

0  0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

l 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

1 

0 

0 

0 

1 

0 

0 

0  0 

0 

1 

0 

0  0 

0 

0 

0 

0 

0  0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

t 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

t 

0 

l 

0 

0 

0 

0  0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

1 

l 

0 

0 

0 

0 

1  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

i 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

l 

l 

0 

0 

0 

0  l 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

l 

0 

0 

0 

1 

1 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

l 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

1 

0 

0 

0 

1 

0 

1 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

1 

0 

1 

0 

0 

0 

1  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

SECTOR 

MODE 

INVERT 

CTCU 

m 

21 

Figure  13  Contents  of  tho  Latch 


139 


r 


y 


THE  OR  OF  THE  REGULARLY  PI STR I SLfTED  LATCH  CONTENTS 
AND  THE  EXTERNAL  INPUTS 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

1 

1 

1 

2 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

1 

1 

1 

2 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

J 

0 

1 

0 

J 

3 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

l 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

3 

0 

1 

1 

1 

0 

] 

3 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

2 

1 

1 

1 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

2 

1 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

2 

1 

0 

3 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

1 

1 

3 

2 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

1 

0 

2 

1 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

I 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

2 

1 

1 

1 

1 

0 

1 

1 

0 

0 

0  0 

0 

p 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

SECTOR  MODE  INPUT  CYCLE  -  22 

Figure  20  The  Of!  of  the  Regularly  Distributed 
Latch  Contents  and  the  Inputs 


THE  INVERTED  OUTPUTS  OF  THE  NOR  SATES 


0  0  0 

0 

0 

1 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0.0  0 

0 

1 

0 

0 

0 

0 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

1 

0 

0 

0. 

,0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

I 

0 

0 

0 

0 

1 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

1 

0 

D 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

1 

0 

1 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

1 

1 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

l 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

1 

3 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

3 

0 

0 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

1 

0 

0 

0 

1 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

1 

0 

1 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0  0  0 

0 

0 

0 

0 

0 

0  0 

0 

0 

0 

0 

0 

0 

0 

D 

0 

0 

0 

0 

0 

0 

0  0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

SECTOK 

MODE 

IK  VERT 

CYCLE 

m 

22 

Figure 

22 

The  NOT  of 

the 

Array 

Figure  23  "Amide  Kuzi"  Customizing  Pattern 
and  Interconnection  Network 


THE  OR  or  THE  CUSTOMIZING  PATTERN 


1 

1 

1 

1 

1 

0 

0 

3 

1 

1 

0 

0 

3 

1 

3 

3 

3 

3 

3 

3 

3 

3 

3 

1 

1 

1 

2 

0 

1 

2 

1 

1 

0 

0 

1 

I 

3 

I 

I 

1 

I 

3 

3 

I 

3 

I 

1 

3 

2 

1 

1 

2 

0 

1 

2 

1 

3 

1 

3 

3 

1 

3 

1 

3 

3 

3 

3 

3 

3 

1 

1 

1 

3 

2 

0 

1 

2 

1 

1 

0 

0 

3 

3 

3 

1 

3 

3 

3 

3 

3 

1 

1 

1 

1 

1 

1 

1 

2 

2 

0 

2 

2 

1 

3 

1 

3 

l 

3 

3 

3 

3 

1 

3 

3 

3 

1 

1 

1 

1 

0 

2 

1 

2 

0 

1 

1 

3 

3 

0 

1 

3 

1 

3 

1 

3 

3 

3 

3 

1 

1 

1 

1 

2 

2 

1 

1 

0 

2 

2 

1 

3 

3 

2 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

1 

1 

0 

1 

1 

2 

0 

1 

1 

1 

1 

0 

3 

1 

1 

1 

1 

3 

3 

I 

3 

3 

l 

2 

1 

1 

2 

2 

1 

2 

0 

1 

2 

1 

2 

3 

1 

3 

1 

3 

3 

1 

3 

3 

i 

l 

1 

1 

1 

0 

1 

0 

2 

2 

1 

1 

3 

3 

0 

3 

1 

3 

1 

3 

3 

1 

3 

3 

1 

1 

2 

1 

3 

1 

1 

2 

1 

1 

0 

3 

3 

2 

3 

3 

3 

3 

3 

3 

1 

3 

3 

1 

1 

1 

1 

0 

0 

1 

1 

2 

0 

1 

2 

3 

1 

l 

3 

3 

3 

3 

3 

3 

3 

3 

1 

1 

2 

2 

1 

3 

1 

1 

1 

1 

2 

0 

3 

1 

1 

1 

3 

3 

3 

3 

3 

3 

3 

1 

1 

1 

1 

1 

0 

0 

1 

1 

2 

0 

3 

2 

3 

3 

3 

3 

3 

1 

3 

3 

3 

3 

1 

1 

1 

1 

2 

2 

3 

1 

2 

1 

1 

2 

0 

3 

3 

3 

3 

3 

1 

1 

3 

3 

3 

1 

1 

1 

1 

0 

1 

1 

1 

0 

0 

1 

2 

3 

2 

1 

3 

3 

3 

1 

3 

1 

3 

3 

3 

1 

1 

1 

1 

2 

2 

2 

1 

3 

2 

1 

0 

3 

3 

3 

3 

3 

3 

3 

3 

1 

3 

3 

3 

1 

1 

0 

1 

3 

1 

0 

0 

2 

1 

2 

1 

3 

3 

3 

3 

3 

1 

3 

3 

3 

3 

1 

2 

l 

1 

2 

2 

1 

3 

1 

2 

1 

3 

1 

0 

3 

1 

3 

3 

3 

3 

3 

3 

3 

1 

1 

1 

1 

0 

1 

0 

1 

1 

0 

1 

2 

3 

3 

1 

1 

3 

3 

1 

3 

i 

3 

i 

1 

1 

2 

3 

3 

1 

t 

2 

1 

2 

1 

0 

1 

1 

1 

1 

3 

1 

3 

3 

3 

3 

3 

1 

1 

1 

1 

1 

1 

1 

1 

1 

2 

1 

2 

2 

1 

1 

1 

3 

3 

3 

3 

1 

3 

3 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

3 

i 

3 

3 

3 

1 

3 

3 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

3 

1 

1 

3 

3 

3 

3 

3 

3 

3 

3 

3 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

3 

1 

l 

3 

\ 

3 

3 

3 

3 

1 

3 

SECTOR  MODE  CUSTOMIZE  CYCLE  -  22 


Figure  21  The  OH  of  the  Customizing  Pattern 
and  Figure  20 
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Discussion  (Alan  Huang;  Discussion  Leader;  Stewart  A.  Collins) 


C.  You  referred  to  the  customizing  masks  with  which  you  essentially  set  the  state  of  the  system.  I  think 
of  this  as  an  opclcal  micro-progranaaer . 

R.  Yes,  it  Is  an  optical  way  of  specifying  the  hardware,  and  on  another  level  it  is  a  micro-programmer. 

Q.  Have  you  considered  problems  that  people  back  off  from  doing  with  conventional  technology?  For  example, 
in  designing  X-ray  cubes,  the  computer  solution  of  Poisson's  equation  in  3-D  is  prohibitive  in  time  and 
money,  the  same  problems  come  up  whenever  you’re  trying  to  solve  a  partial  differential  equation. 

A.  In  solving  a  diffusion  equation  or  heat  equation,  the  procedure  is  something  like  balancing  the  mean 
between  che  extremes.  I  think  chat  is  a  very  nice  local  operation  if  you  can  work  out  the  programming  of 
interconnects  so  each  cell  will  do  that  type  of  thing. 

R.  It  might  be  a  simple  program  compared  to  the  more  sophisticated  algorithms  that  are  used  now,  like  the 
finite  difference  technique  which  recasts  che  whole  problem  as  a  matrix  problem.  It  may  be  possible  to  use 
a  simple  relaxation  technique  and  jusc  let  the  optical  computer  cycle  through  until  a  solution  is  obtained. 

It  wouldn't  even  be  necessary  for  everyone  to  have  one  of  these  computers  if  it  was  possible  to  use  a  time¬ 
sharing  system  and  have  a  few  of  these  at  centers  that  could  afford  them. 

Q.  You've  been  working  on  this  general  purpose  optical  idea  for  a  year  or  two  now.  Have  you  developed 
some  thoughcs  as  to  what  its  particular  strengths  might  be? 

A.  At  first  I  had  to  use  a  pipeline  architecture  because  I  was  watching  very  few  bits  change  on  a  simula¬ 

tion  of  a  regular  finite  state  machine.  What  I  was  doing  was  re-creating  the  bottleneck  in  software  which 
I  had  spent  all  my  time  avoiding  by  using  the  parallelism  of  optics.  Also,  it  was  a  little  too  tight  in 
terms  of  the  competition,  so  I  stacked  the  deck  and  found  things  that  are  very  difficult  for  them  to  do. 

One  such  thing  is  the  case  where  you  want  to  do  a  weighted  mean  of  values  that  are  2  or  3  neighbors  distant 

in  an  array.  This  would  require  a  prohibitive  number  of  interconnects  for  a  parallel  electronic  processor. 
I'm  staying  more  toward  che  Interconnect  problems  because  that  is  where  optics  has  an  advantage  since  I  am 
doing  these  interconnects  in  space. 

Q.  You've  designed  your  operations  around  the  NOR  gate.  If  you  had  your  choice  of  3  or  4  different  logic 
operations,  which  would  you  prefer? 

A.  I  did  che  NOR  gate  because  optically  you  get  Che  OK  for  free,  so  the  basic  operation  you  have  to  get  is 
the  NOT  operation,  which  is  very  difficult.  I  would  also  be  satisfied  with  the  HAND  operation.  For  all 
other  operations,  you  need  a  combination  of  two.  A  computer  designer  is  perfectly  happy  with  NOR's. 

Q.  If  you  had  a  way  to  do  Che  interconnections,  would  you  be  able  to  do  arbitrary  algorithms? 

A.  Yes. 

Q.  Would  you  have  to  change  che  interconnection  pattern? 

A.  No,  the  interconnect  pattern  is  fixed,  that's  simple  and  primitive.  You  would  Just  project  another 
customizing  pattern. 

C.  Keyes  at  IBM  has  done  a  famous  analysis  of  different  types  of  logic  elements  from  the  point  of  view 
of  their  limitations.  His  conclusion  was  that  optical  logic  was  not  viable  because  of  the  high  energy  Inv¬ 
olved  and  the  cost  of  a  photon.  He  thought  that  the  heat  problem  which  is  preventing  Si  technology  from 
going  much  farther  was  even  worse  for  optics.  You've  introduced  a  new  twist  here.  You've  said  that  you 
don't  require  nanosecond  switching  times,  which  might  alleviate  that  problem  and  get  around  Keyes. 

R.  Some  people  mentioned  that  they  now  have  integrated  optic  components  that  can  latch  with  less  than 
100  photons  of  energy,  and  that  is  quite  sensitive.  You  can  make  che  liquid  crystal  light  valve  more  non¬ 
linear  and  t  think  you  can  get  some  speed  that  way.  One  tendency  I  have  is  to  cake  the  output  and  feed  it 
back  to  put  some  gain  in  the  system,  but  that  is  still  trading  time  for  energy.  The  whole  architecture  is 
not  basing  my  throughput  on  switching  speed,  it's  che  parallelism. 

C.  Keyes  was  calking  about  an  exact  mimic  of  digital  logic  with  single  channels  and  single  gates,  and  par¬ 
allelism  Introduces  a  new  dimension. 

R.  Especially  if  you  limit  the  number  of  times  you  have  to  re-create  a  photon.  A  photon  is  an  electron 
volt,  and  that's  a  lot  of  energy. 

C.  In  electronics,  people  started  out  with  analog  computers  and  eventually  found  out  they  could  get  more 
uae  out  of  the  logic  and  dynamic  range  of  digital  devices.  It  seems  now  we're  in  the  analog  stage  even  in 
image  processing.  Could  it  b%  that  eventually  we'll  want  to  shift  over  to  eome  form  of  digital  parallel 
optical  image  processors? 
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Panel  Discussion 

l  „  Moderator:  John  Ualkup  (JV) 

Panelists:  Bud  Vanderlugt  (BV),  Joe  Goodman  (JG),  Sandy  Sawchuk  (SS),  Harper  Whitehouse  (HVi) 

(Key:  C  *  Comment,  0  *  Question,  R  *  Response.) 

JV:  Just  for  the  record,  the  panel  consists  of  Bud  Vanderlugt,  Joe  Goodman,  Sandy  Sauchuk  and  Harper  White- 
house.  1  very  much  want  to  encourage  questions  and  comments  from  the  rest  of  the  participants  so  that  the 

-  panel  not  do  all  the  talking.  I  thknk  they  would  concur  with  that.  It  is  hard  to  know  exactly  where  to 

start.  There  was  a  question  submitted  and  this  is  the  only  question  that  was  put  in  the  box.  Maybe  it  is  a 
good  place  to  start: 

Q:  What  is  the  advisability  of  pursuing  optical  binary  logic  techniques  in  the  presence  of  the  electronic 

digital  capability? 

BV:  My  thoughts  right  now  go  back  to  experiences  of  block  oriented  holographic  memories.  The  question  1 

have  is,  even  if  we  can  get  the  switching  speeds  and  get  enough  of  the  devices  developed,  is  the  volume  that 

is  dependent  on  free-space  propagation  that  may  be  required  in  some  of  these  applications  going  to  be  such 
that  we  can  package  it  in  a  viable  size  and  with  the  kinds  of  power  consumptions,  etc.  that  are  competitive 

with  the  digital  approaches.  I  think  that  has  a  lot  to  do  with  the  way  in  which  the  system  architecture  is 

structured.  1  know  that  when  we  look  at  holographic  memories  with  block  oriented  random  access  structures, 
we  can  get  very  nice  packing  density  in  the  Fourier  plane,  but  when  we  consider  the  tremendous  volume  that  is 
required  for  the  free-space  propagation  to  get  the  beams  there,  do  the  Fourier  transformations,  etc.,  the 
total  system  size  will  be  large,  i.e.  the  volume  packing  density  is  not  all  that  high.  I  wonder  whether  the 
same  issue  may  be  applicable  here. 

JG:  It  seems  to  me  there  are  two  directions  one  can  go  here.  One  is  towards  making  extremely  fast  logic 
elements,  and  indeed  there  are  people  working  on  that.  They  have  hopes  of  far  surpassing  what  can  be  done 
’  with  GaAs  technology.  I  think  Alan  Huang  put  his  finger  on  the  other  kind  of  approach,  which  is  not  to  fight 

the  speed  battle,  but  to  try  to  employ  the  massive  parallelism  that  we  have  available,  in  trying  to  achieve  a 
large  number  of  operations  per  second  through  parallelism  rather  than  through  basic,  fundamentally  superspeed 
devices.  I  think  that  is  a  good  insight. 

HW:  I  have  feet  in  both  camps.  I'm  working  with  the  Navy  on  its  VHSIC  program  which  is  going  to  be  the 
panacea  of  five  years  from  now  for  all  of  digital  processing.  We  can't  even  solve  all  current  Navy  systems 
from  the  projected  components.  Part  of  the  problem  is  that  much  of  the  VLSI  chip  is  typically  taken  up  with 
internal  interconnects,  thus  only  the  most  regular  arrays  can  be  implemented  in  VLSI.  The  pin  limitations 
on  the  chips  are  such  that  much  beyond  128  pins/chip,  people  will  begin  to  not  see  how  they  are  going  to 
package  it  and  how  they  are  going  to  test  it.  Also  with  the  very  fine  line  geometries,  people  are  beginning 
to  become  concerned  about  how  these  are  going  to  behave  with  soft  errors  and  cosmic  ray-induced  errors.  I 
feel  that  the  solution  to  the  problem  is  not  to  try  to  make  things  work  faster.  People  are  working  with 
Josephson  junction  devices  to  get  speed.  When  you  ask  as  we  did  on  the  program,  how  would  Josephson  junction 
devices  solve  the  same  Navy  problem  as  is  being  addressed  by  the  three  optical  computers,  we  find  that  even 
with  the  existence  of  the  Josephson  junction  computer,  postulating  that  the  computer  now  exists,  we  then  had 
to  postulate  a  Josephson  junction  array  processor  to  go  with  the  Josephson  junction  computer  in  order  to  be 
able  to  solve  the  problem.  So  speed  (per  se)  does  not  do  it.  I  believe  it  is  the  exploitation  gf  the  2-D 
structure  and  addressing  those  algorithms  which  are  of  NJ  today,  just  as  the  FFT  addressed  the  K  operations 
problem  of  the  DFT.  But  before  one  starts  on  that  we  have  a  precursor  that  has  come  out  of  Stanford  Univer¬ 
sity  for  the  inversion  of  a  class  of  matrices  which  now  takes  NJ  operations.  They  have  nov  been  able  to  show 
algorithms  with  cr  IHlogj  N)  operations,  however,  a  unfortunately  ranges  between  N  in  the  worst  case,  to  1  in 

the  best  case.  So  we  have  to, fight.  One  is  not  sure  jxactly;  but  for  many  problems  a  is  a  small  numbej,  and 

notice  that  we  have  reduced  NJ  operations  to  N(log,  N)  .  So  even  though  optical  processing  can  bring  N 
processors  to  bear,  the  algorithm  people  are  not  sitting  back  idly,  and  Stanford  University  is  addressing  the 
problem  of  VLSI  through  algorithm  research.  So  I  think  it  is  going  to  be  nip  and  tuck. 

SS:  1  don't  know  if  there  is  a  great  deal  that  I  can  add  to  this  except  to  say  that  there  is  a  lot  of  work 
that  remains  to  be  done  in  studying  the  architecture  of  both  parallel  digital  processors  and  the  architecture 
of  parallel  optical  processors.  And  people  like  Alan  Huang  and  others  have  just  begun  to  think  about  what 
you  can  do  with  the  parallel  optical  logic  of  residue  arithmetic  arrays.  As  Alan  said,  and  1  agree  with  this, 
I  think  that  one  should  not  be  impressed  with  speed  at  the  moment  or  be  so  concerned  with  it.  But  instead 
think  what  can  be  done  with  parallel  processors.  Try  to  identify  those  specific  problem  areas  that  would 
benefit  from  a  parallel  processor.  To  me  it  seems  that  one  of  the  areas  is  in  dealing  with  data  that  is  page 

organized  to  begin  with.  Such  data  is,  for  example,  images  of  any  kind,  2-D  arrays  as  sonar,  radar,  whatever 

you  have.  So  these  are  natural  candidates  for  some  sort  of  parallel  processor  and  we  should  try  to  examine 
these  problem  areas,  find  out  what  problems  digital  people  have,  and  they  are  considerable.  Another  thing  is, 
as  Harper  said,  VLSI  and  other  technologies  that  are  being  explored  now  are  sort  of  billed  as  the  universal 
solid  state  answer  to  all  these  problems,  and  they  really  are  not,  because  they  have  many  fundamental  pr°h* 
lems.  Among  them  is  the  interconnection  problem  of  the  different  units.  In  an  optical  computer  you  might 
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imagine  Chat  interconnection  is  easier.  But  it  does  cake  space,  as  Bud  pointed  out.  It  takes  a  reasonable 
amount  of  space  for  light  to  propagace  over  a  Fresnel  distance,  or  whatever  it  takes  Co  get  the  Fourier  trans¬ 
form.  So  we  night  look  at  perhaps  trying  to  3hrink  the  sizes  of  these  things  by  combining  them  with  fiber 
optics  and  incegraced  optics.  And  finally,  and  this  is  a  wild  idea  by  a  guy  who  does  not  know  much  about 
integrated  optics,  except  we  have  aii  heard  a  loC  about  2-D  integrated  optics,  I  am  wondering  what  Che  possi¬ 
bilities  are  of  3-D  integrated  optics  for  doing  some  of  these  massive  shrinking  and  size  reduction  types  of 
chings  we  have  been  hearing  about.  This  is  something  perhaps  we  can  come  back  to  later  and  calk  to  l3ai  about. 

JW:  Chen  (Tsai),  do  you  want  to  respond  to  3-D  optics? 

R:  At  chis  time  we  have  enough  problems  with  2-D.  But  I  know  that  in  3-D,  one  possibility  is  to  have  a 

stack,  for  example  for  direction  finding.  At  this  moment  it  seems  to  be  difficult,  but  in  the  meantime  re¬ 
search  progress  in  materials  is  being  made,  IBM  is  growing  thin  layers.  But  it  is  obviously  very  far  away, 
and  I  think  at  this  moment  ic  is  very  difficult.  [Chen  Tsai] 

SS:  I  didn't  really  expecc  chat  there  would  be  a  very  good  answer  on  chis.  But  two  other  things  that  I 
though  of;  as  I  pointed  out  before  I  tried  Co  show  chat  I  really  feel  chat  getting  thresholds,  or  a  parallel 
array  of  thresholds,  is  a  real  key  to  doing  digital  processing.  By  digital  I  mean  by  optical  techniques  as 
opposed  to  analog  optics.  I  also  think  chat  the  digital  technique  is  a  very  big  key  to  accuracy.  This  is 
Che  whole  key  to  an  electronic  digital  computer.  The  reason  why  they  get  the  accuracy  is  because  of  its 
thresholding  nature.  And  perhaps  we  don't  want  to  mimic  this  exactly  with  optics,  but  at  least  we  should  be 
able  to  do  a  threshold,  and  this  is  a  key  to  doing  any  kind  of  logic-decision  making,  branching,  testing,  and 
all  the  other  things  that  one  can  do  with  an  electronic  computer.  Finally  the  ocher  thing  that  I  want  co  say 
concerns  iteration.  In  order  to  do  some  of  these  techniques,  like  solving  a  set  of  equations  such  as  Harper 
mentioned,  you  need  iteration.  This  implies  feedback  and  implies  memory.  You  have  to  be  able  to  store  com¬ 
puter  results  somewhere,  bring  them  back  and  work  on  them  again  and  again  and  again.  This  is  something  that 
electronic  digital  computers  can  do  and  I  guess  people  are  thinking  about  this  with  optics.  But  this  is 
again  a  part  of  the  big  architecture  question. 

C:  I  would  like  to  endorse  the  viewpoints  that  you  have  mentioned.  One  is  that  you  should  utilize,  what 

was  actually  expressed  by  Joe  and  others,  the  progress  Chat  has  been  made,  and  also  is  in  Che  making,  in 
fiber  optic  systems.  Optical  signal  processing  systems  should  utilize  this  progress,  that  is  very  important. 
The  second  thing  to  study  is  what  the  suitable  architectures  are  to  go  with  these  planar  structures  such  as 
2-D  time  Integrated  correlators.  [Chen  Tsai] 

JW;  When  we  talk  about  thresholding,  and  it  was  mentioned  in  one  of  che  talks,  if  we  have  feedback  then  we 
can  get  some  of  these  functions.  There  has  been  relatively  little  talk  about  issues  such  as  the  optical  op¬ 
erational  amplifier.  I  know  that  Sing  Lea  has  been  working  on  something  like  that  and  Marlon  Kagler  here  at 
Tech  did  a  fair  amount  of  analytical  work  on  what  the  requirements  will  be.  How  useful  in  Che  opinion  of  the 
people  here,  or  how  critical  will  It  be,  Co  develop  an  optical  on  amp  that  can  work  on  2-D  data?  A  lot  of 
things  we  talked  about  almost  imply  chat  we  need  iteration,  we  may  need  feedback  and  we  need  high  gain. 

KW:  I  chink  I  would  vote  for  the  optical  comparator  first.  By  comparator  I  mean  not  just  a  threshold  but  a 
threshold  for  which  I  can  control  where  the  threshold  is.  I  mean  it  to  act  like  a  two  dimensional  array  of 
comparators . 

JW:  We  know  that  Adolf  has  done  a  fair  amount  of  work  on  TV  optical-electronic  op  amps  and  has  got  very 
interesting  results. 

C:  You've  already  got  your  optical  op  amp-the  image  intensifier  tube.  But  the  key  item  you  want  is  an  op¬ 

tical  op  amp  which  has  negative  dynamic  gain  characteristics.  [Stuart  Collins] 

JW;  Let  me  get  lnco  a  couple  of  questions  chat  were  on  chis  sheet  that  I  filled  out.  I  had  two  that  seemed 
to  go  together;  What  subareas  of  optical  Information  processing  appear  most  promising  for  dramatic  develop¬ 
ments  over  che  next  decade:  In  other  words  ars  there  3,  4,  or  5  that  you  would  say  are  right  on  the  verge 
of  breakthroughs  or  could  be  on  the  verge  of  significant  breakthroughs? 

SO:  I  wouldn't  like  to  answer  that  question,  but  I  would  like  to  rephrase  it,  because  I  think  in  order  to 
answer  chat  question  we  need  a  crystal  ball  and  I  don't  have  it.  I  think  a  better  question  would  be  what  new 
developments  do  we  see  that  might  potentially  have  something  to  offer  to  optical  data  processing,  but  at  this 
particular  stage  for  such  developments  ic  is  likely  to  be  too  early  to  tell.  The  only  way  to  find  out  is  if 
you  pursue  them  with  vigor  for  awhile  to  see  what  comes  out  of  them  and  I  think  I  would  put  into  chat  cate¬ 
gory  right  now  the  various  ideas  that  have  been  developed  for  using  four-wave  nixing  for  correlations,  con¬ 
volutions,  and  various  things  like  this.  This  is  basically  a  dynamic  light  valve  of  the  sort  that  performs 
nonlinear  operations.  It  seems,  at  face  value  anyway,  to  have  enormous  possibilities,  at  least  to  the  degree 
chat  dtsarvea  further  Investigation.  Maybe  after  looking  at  It  for  awhile  we  will  begin  to  see  the  defects 
as  we  always  do  after  we  examine  something  for  awhile,  but  at  this  point  of  time  is  seems  to  be  an  area  that 
really  should  ba  looked  at  carefully. 

JW:  Anybody  else  on  the  panal  want  to  respond? 
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HU:  I  chink  it  is  precision.  I  chink  until  the  problem  of  optical  precision  has  been  addressed  there  vlll 
never  be  any  rest  to  the  problem  of  competition  from  the  digital  community.  Only  when  that  problem  is  addres¬ 
sed,  when  we  can  say,  "1  will  compare  my  8  bit  digital  system  with  your  8  bit  optical  system,"  then  we  car. 
get  down  to  the  size,  weight,  power,  and  cost  comparison. 

JU:  Is  it  precision  or  is  it  a  sort  of  throughput  times  precision  or  some  throughput  accuracy? 

HU:  I  think  it  is  precision,  at  sufficient  throughput  to  solve  the  problem;  excess  throughput  beyond  that 
required  to  solve  the  problem  I  don't  think  is  needed. 

JW:  I  think  that  is  a  task-oriented  thing. 

JG:  I  agree  with  Harper  that  precision  is  a  key  thing  that  we  should  be  focusing  on  and  certainly  we  devoted 
some  of  our  efforts  to  it  at  Stanford  in  the  past  fev  years.  But  I  wanted  to  raise  a  paradox,  i.e.,  if  we 
believe  Shannon,  the  Information  rate  that  is  coming  out  of  a  processing  system  is  linearly  proportional  to 
the  throughput,  but  only  logarithmically  proportional  to  the  number  of  resolvable  levels.  Therefore  doubling 
the  number  of  bits  chat  we  have  available,  there  should  be  a  very  substantial  increase  in  dvnamlc  range, 
which  in  Shannon's  terms  is  only  equivalent  to  doubling  the  throughput  rate,  and  1  can't  quite  understand  why 
Shannon  tells  me  one  thing  and  my  intuition  tells  me  another.  I  wonder  if  you  have  any  comments  on  that. 

HU:  The  Intuition  loses:  I  think  that  this  is  a  problem  that  should  be  addressed  from  the  information  theo¬ 
retic  point  of  view.  We  need  to  put  optical  processing  on  the  same  basis  that  I  think  has  been  done  with 
super-conductivity.  In  Conway  and  Meades'  new  book,  chapter  9,  there  is  an  interesting  comparison  between 
MOS  technology  and  Josephson  junction  technology.  Based  upon  quantum  physics  arguments,  which  show  that  as 
we  scale  devices,  then  semiconductor  technology,  the  MOS  technology  in  particular,  improves  in  performance: 
one  type  of  Josephson  junction  technology  is  neutral,  i.e.  it  makes  no  difference,  and  another  type  of  super 
conducting  technology  loses,  actually  it  is  worse  as  the  resolution  increases.  I  think  we  need  to  address 
questions  like  these,  the  information  theoretic  one,  and  we  need  to  get  down  and  address  them  at  university 
level  physics.  I  would  like  to  see  optical  processing  plotted  on  the  same  curve  that  has  semiconductors  and 
Josephson  junction  devices.  1  think  we  have  to  have  all  three  put  together  from  a  physics  point  of  view,  then 
we  can  answer  some  of  these  comparison  questions. 

Ci  You  talked  about  addressing  accuracy  in  optical  processing.  That  has,  in  the  last  year,  really  evolved 
as  a  major  criteria  for  digital  processing.  People  are  trying  to  build  them  smaller  and  faster.  One  thing 
they  have  found,  that  up  until  last  year  they  have  overlooked,  is  the  quantization  error  that  occurs  in  that 
processor  which  is  dependent  on  the  structure  of  that  processor.  So  now  when  you  are  comparing  digital  pro- 
eessors  you  must  address  this  quantization  error  problem.  So  even  in  digital  processing  with  IC's,  accuracy 
is  still  a  major  consideration. [Bill  Sander] 

HU:  At  this  point  I  would  like  to  make  a  comment  on  that.  Something  recently  has  come  out,  i.e.  people 
addressing  this  problem  have  made  a  comparison  between  modem  spectral  processing  techniques  with  the  old 
fashioned  ones.  One  can  show  theoretically  that  under  many  circumstances  this  should  not  make  any  difference. 
Yet  significant  improvements  in  Navy  systems  are  possible.  When  you  apply  the  techniques  that  should  not  work 
mathematically  any  better  than  the  other  ones,  they  do.  Thus  recently  there  has  been,  out  of  ONR,  a  new  set 
of  opportunities  in  addition  to  contract  research  opportunities  which  have  been  available  for  many  years. 
Starting  one  year  ago  there  are  SRO's,  select  research  opportunities.  This  is  the  second  year.  And  for  those 
in  the  optical  signal  processing  community  two  of  them  are  of  interest.  One  addresses  non-Gauasian  signal 
processing,  the  other  addresses  non-stat ionary  signal  processing.  I  would  like  to  mention  to  those  of  you 
who  are  looking  for  things  to  submit,  take  a  look  at  these  select  research  opportunities.  You  may  find  some¬ 
thing  for  optics. 

JW:  Does  anybody  in  the  audience  want  to  respond? 

C:  1  just  want  to  make  a  consent.  Over  the  last  3  years  there  has  been  diversity  in  processing  techniques, 

in  architectures.  From  what  we  heard  yesterday,  when  you  go  to  talk  to  people  that  are  in  the  digital  world, 
they  are  kind  of  locked  into  certain  architectures  of  computers.  1  think  that  maybe  this  community  should 
be  trying  to  keep  the  diversity  of  architecture  of  optical  computers  coming  on.  Lots  of  times  you  look  at 
them  and  they  end  up  being  essentially  some  kind  of  Fourier  transforms  and  correlations  and  you  are  pretty 
much  stuck  with  them.  Try  to  put  them  into  different  concepts  and  to  keep  novel  new  architectures  alive. 
Microprocessors,  I  think,  have  made  many  people  come  and  look  at  strange  architectures  for  computing  systems 
and  it  is  strange  in  the  sense  that  they  had  not  thought  about  this  when  they  were  thinking  about  large  scale, 
big  throughput  systems  and  now  1  think  the  optical  comunity  should  try  to  keep  looking  into  these  kinds  of 
areas.  [Terry  Stalker] 

JW:  Let  me  ask  a  question  related  to  who  tackles  what  problems  ir.  basic  research,  so  to  speak.  It  seems  like 
on  the  one  hand  there  is  a  need,  especially  I  think  it  is  perceived  by  the  DOD  community,  to  have  the  research 
that  is  done  address,  or  at  least  have  implications  for,  the  needs  that  are  sensed  by  the  DOD.  On  the  other 
hand  1  hear  people  like  Bob  Guenther  saying  you've  got  to  look  at  the  basic  physics,  what  are  the  fundamental 
limitations?  When  you  start  talking  about  fundamental  limitations  it  seems  like  you  really  have  to  go  beck 
to  very  basic  approaches  which  may  appear  to  be  a  kind  of  work  that  is  rsther  uncoupled  with  any  needs,  or 
loosely  coupled  with  direct  mission  oriented  kinds  of  things.  I  think  this  is  a  dilemma  sometimes  for  the 
people  in  the  universities  who  really  are  the  people  who  should  be,  or  maybe  are,  interested  in  pursuing  some 
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of  these  basic  problems.  Very  basic  cypes  of  chings  chat  make  good  theses  ar.d  dissertations,  whereas  the 
things  that  are  a  little  farcher  along  che  development  chain  are  not  always  as  suitable  for  theses  and  disser¬ 
tations.  Is  chere  a  dilemma  there?  I  see  the  Army  people  shaking  their  heads  saying  no. 

C:  There  is  no  dilemma  chere.  Me  are  the  ones  who  are  responsible  for  identifying  the  roles  of  the  very 

basic  research.  And  that  is  why  we  say  contact  us-phone  call,  letter,  proposal,  whatever.  If  we  don't  see  the 
need  for  chat  work  ultimately,  or  even  in  ten  years  from  now,  we  will  cell  you.  And  you  have  an  opportunity 
to  argue  your  point  of  view.  But  it  is  really  our  job  to  do  that  relevance  evaluation,  not  yours.  We  want  to 
identify  the  areas  that  we  can  tell  you  that  we  are  interested  in;  that  doesn't  mean  chat  it  should  exclude 
anything,  that's  not  what  we  talk  about  because  we  like  to  hear  new  ideas  also.  Maybe  something  we  have  not 
choughc  about.  [Bill  Sander] 

C;  Me  aren't  flooded  with  a  lot  of  novel,  basic  research  proposals.  [Bob  Guenther] 

C;  There  are  some  things  in  basic  research  that  the  Army  does  not  fund.  We  don't  fund  astronomy,  we  don't 

fund  elementary  particles,  we  fund  very  little  work  in  plasma  physics.  But  otherwise  we  are  even  given  the 
latitude  that,  if  we  can't  even  think  up  an  application,  we  have  252,  roughly,  that  we  can  say  'this  is  the 
one  chac  we  think  is  worth  a  risk.’  It  is  just  good  science,  we  do  have  chat  option.  But  we  just  don't  get 
flooded  with  a  lot  of  ones  that  we  have  to  come  to  that  kind  of  decision.  [Bob  Guenther] 

JW:  There  is  an  interesting  quescion  as  Co  why  you  don't  get  flooded. 

C:  We  are,  all  the  OSR's,  are  a  service  organization  to  the  different  branches  of  the  DOD,  and  NSF  is  the 

government's  response  to  basic  research  and  support.  So  we  shouldn't  see  a  lot,  maybe,  but  there  are  parts 
of  basic  research  that  all  of  us  that  work  in  che  OSR's  would  give  our  right  arm  to  see  in  our  program.  [Bob 
Guenther] 

HW:  May  I  point  out  that  there  is  one  player  missing  from  this  discussion,  and  that  is  ARPA.  Somebody  com¬ 
mented  chac  in  comparing  6.1,  6.2,  6.3,  chere  is  an  order  of  magnitude  of  increase  in  available  dollars  as  one 
goes  towards  advanced  development.  While  we  all  like  to  think  that  we  are  doing  fundamental  research,  we 
often  have  to  take  6.2,  or  exploratory  development  dollars,  in  order  co  have  enough  money,  and  then  divert  a 
fraction  of  those  development  dollars  into  supporting  research  at  the  same  time  we  are  doing  development. 

Don't  overlook  ARPA.  ARPA  has  the  dollars,  the  interest  at  the  6.2  level  of  development,  but  they  will  also 

work  with  you,  and  let  you  Cake  and  redirect  a  portion  of  their  money  into  research. 

C;  They  have  the  6.1  money? 

HW:  They  do  also.  But  they  also  let  you  cake  6.2  money  and  direct  a  portion  of  that,  so  that  you  can  get  a 

single  contract  from  ARPA,  which  tends  to  be  a  bit  more  applied,  and  then  you  can  turn  to  a  university  and 

support  some  student  with  a  small  fraction  of  that  money.  They  are  not  represented  at  this  meeting.  So  at 
least  somebody  ought  to  think  about  them. 

C:  Basically  this  is  true  in  any  of  the  DOD.  You  can  spend  any  of  the  higher  level  money  for  basic  re¬ 

search;  you  can't  spend  basic  research  money  for-higher  levels.  [Bill  Sander] 

JW:  I  wondered  if  that  would  be  a  controversial  question.  I  had  hoped  that  we  could  get  A1  Schutzman  and 
Nora  Kaplan  here.  In  fact  they  were  invited  and  I  think  they  were  giving  some  testimony  before  Congress, 
so  they  were  unable  to  come.  But  certainly  NSF  is  an  important  place  to  look  for  basic  research  funds. 

JG:  I  had  just  a  comment.  I  am  convinced  chat  it  is  a  delightful  situation  that  places  like  ARO  are  really 
looking  for  basic  research  proposals.  But  from  the  university  point  of  view,  and  over  my  professional  life¬ 
time,  chere  seems  to  be  a  wave,  it  goes  up  and  it  goes  down,  and  I  can  only  too  vividly  remember  the  time 
when  the  Joint  Services  Program  for  example  did  not  want  co  be  bothered  with  anything  that  did  not  have  a 
very  clear  relevance  to  some  particular  mission.  And  I  chink  s  lot  of  us  who  went  through  that  period  still 
have  that  memory  in  our  minds  and  may  hold  back  from  proposing  anything  that  is  really  too  divorced  from 
either  building  a  piece  of  equipment  or  some  kind  of  direct  relevance. 

JW:  I  will  jusc  use  chls  as  an  illustration;  but  it  seems  like,  when  you  are  talking  about  areas  like  sta¬ 
tistical  optics,  there  are  relatively  few  people  working  in  applying  these  areas  who  are  really  looking  at 
fundamental  limitations  and  che  tools  are  there  to  answer  some  of  these  questions. 

C:  There  are  two  research  programs  in  our  programs  chat  are  directed  Cowards  chose  kinds  of  questions.  One 

about  coherence  theory  and  there  are  one  or  two  directed  cowards  statistical  problems  in  optics.  You  just 
don't  see  them  because  in  a  meeting  like  chls  you  don't  bring  up  someone's  theory  of  propagation.  [Bob 
Guenther] 

C:  I  might  make  a  plug  for  the  sensors  and  devices  as  areas  needing  additional  investigation.  I  think  the 

one  key  Important  issue  we  have  not  addressed  is  the  materials  research.  After  all,  device  research  boils 
down  to  materials,  and  the  interaction  of  light  with  matter,  and  there  are  various  effects,  like  electro- 
optic  effects,  the  acousto-optic  effect;  the  magneto-optic  effect  is  hardly  used  except  in  magnetic  bubble 
domains  and  chac  kind  of  chlng.  There  are  probably  other  effects  out  there  chat  night  be  useful  for  optical 
information  processing  chac  we  have  not  addressed.  And  I  would  like  to  see  more  emphasis  on  fundamental 


physics  of  interaction  of  light  with  materials.  Can  we  get  a  larger  index  change  for  a  smaller  field,  should 
we  dope  the  materials  and  what  we  should  dope  them  with?  I  think  it  is  very  limited.  Lithium  niobate  and 
lithium  tantalate  and  KDP  seem  to  be  the  only  materials  that  we  ever  use  in  all  the  discussions  I've  heard 
in  the  last  two  days.  There  are  biological  materials  out  there,  there  are  large  molecule  proteins  that  I 
know  seem  to  have  some  optical  properties  that  might  be  useful.  B».t  none  of  us  are  looking  at  those  things. 

A  proposal  in  such  an  area  might  look  farfetched  and  might  look  more  biological  than  the  Army  might  want  it 
to  look,  but  I  think  chat  we  have  to  think  in  a  much  wider  sphere  of  materials,  both  in  sensors  and  detectors 
and  both  in  devices  for  modulation  of  light  and  processors.  [Cardinal  Warde] 

C:  1  would  like  to  return  to  what  Harper  mentioned  about  precision.  One  thing  that  struck  me  about  reading 

optical  journals  about  image  processing  is  that  we  always  see  pictures  that  are  being  enhanced  or  level 
sliced  or  equidensltometry ,  including  some  of  our  own  work.  But  the  heart  of  any  work  is  mentioning  what  are 
the  input  level  plus  output  levels  put  in  quantized  form.  It  seems  that  many  papers  are  not  talking  about 
precision  at  all.  Most  people  don't  even  document  bits,  12  bits,  15  bits,  it's  difficult  to  even  narrow  down 
to  2-3  bits.  1  think  we  should  all  be  more  careful  about  all  the  pictures,  what  we  mean,  what  kind  of  input- 
output  we  have.  One  thing  I  try  to  use  is  the  transmittance  because  that  i6  an  input-output  which  is  going  to 
be  independent  of  input  intensity,  i.e.  you  have  a  ratio.  [h.K.  Liu] 

HW:  We  have  heard  that  not  a  great  deal  of  precision  is  needed  in  optics  and  I  think  that  is  often  brought 
about  by  considering  visual  images.  As  soon  as  you  go  from  visual  scenes  to  infrared  detection,  much  larger 
dynamic  ranges  are  required,  then  when  one  goes  to  radar  imaging  one  can  get  very  high  dynamic  ranges.  And  sc 
one  man's  problem  for  which  6  bits  is  more  than  adequate  may  be  unacceptable  to  another  man’s  problem.  Just 
as  we  have  microprocessors  at  8  bits  to  the  Cray  I  computer  at  64.  1  think  that  we  need  optical  systems  which 

are  capable  of  handling  different  dynamic  ranges  for  different  problems. 

SS:  In  the  past,  historically  most  optical  systems  are  built  for  visual  uses.  In  the  past  the  human  is  the 
guy  at  the  output  and  he  is  the  final  sensor.  And  with  human  beings  you  can  get  away  with  5  or  6  bits.  But 
now  if  we  are  asking  processors  to  do  anything  nonlinear,  and  this  includes  some  of  the  interesting  things 
like  homomorphic  filtering  for  one  example,  you've  really  got  to  have  much  more  accuracy,  or  else  we  are  going 
to  wind  up  with  results  which  are  just  a  lot  of  noise. 

SS:  One  other  thing  that  I  wc.it  to  talk  about  has  to  do  with  what  Bob  said,  namely,  why  people  don't  get  more 
fundamental  proposals  for  looking  at  these  things.  First  of  all  they  are  very  tough  problems  and  they  require 
probably  development  of  a  totally  new  theory,  and  work  in  statistical  optics  i6  not  developed  enough  to 
answer  some  of  the  fundamental  questions.  What  would  be  nice  would  be  to  make  some  sort  of  an  analysis  of  the 
limitations,  the  physical  limitations;  I  sort  of  look  at  limitations  two  ways.  One  is  the  physical  limitation 
and  the  other  Is  the  practical  limitations.  The  physical  limitations  are  getting  down  to  the  quantum  level. 
How  well  can  you  measure  light?  How  well  can  you  measure  the  signals  that  are  passing  through  systems?  In 
order  to  do  this  we  need  a  lot  of  statistical  tools,  some  of  which  have  not  been  developed.  And  then  only 
after  you  have  these  available  can  you  answer  more  practical  questions  like  what  are  the  noise  limitations, 
the  bandwidth  and  the  power,  size,  and  the  information  throughput,  things  like  this.  So  there  are  lots  of 
questions  that  can't  be  answered  because  the  tools  are  not  available. 

JV:  I  want  to  talk  about  devices  and  the  development  of  devices.  Armand  said  earlier  that  if  we  thought  that 
optics  was  not  going  anywhere  fast  enough,  or  as  fast  as  it  should,  we  can  blame  it  on  the  spatial  light 
modulator  people.  But  it  turns  out  that  there  ave  only  about,  in  the  universities,  three  or  four  that  we 
can  blame  it  on,  so,  I  think  there  is  a  problem  here,  there  are  a  couple  of  problems.  There  are  not  enough 
people  working ,  as  Cardinal  (Warde)  said,  for  example  in  the  universities,  on  development  of  the  basic 
devices.  The  other  issue  is  how  do  you  get  the  spatial  light  modulators,  which  are  very  expensive,  in  to  the 
hands  of  the  people  who  are  doing  the  advanced  techniques  development  to  broaden  the  scope  of  the  things  that 
optical  computers  can  do,  when  a  lot  of  us  cannot  afford  them. 

SS:  Let  me  answer  that.  One  thing  is  that  I  really  want  to  stand  up  for  people  who  do  basic  research  on  the 
properties  of  interaction  of  light  with  matter.  There  are  a  lot  of  questions  out  there  that  need  to  be  an-- 
swered  before  we  can  decide  to  put  a  lot  of  money  and  a  lot  of  resources  on  new  kinds  of  light  valves.  There 
may  be  one  hundred  different  ideas  you  can  have  on  how  to  build  a  light  modulator.  But  you  don't  have  unlimi¬ 
ted  resources,  you  better  pick  two  or  three  good  candidates  by  intuition  or  gut  feeling  or  something  like  that 
and  then  put  your  resources  there.  And  that  is  an  extremely  risky  business  because  the  development  time  is 
very,  very  long,  it  is  very  slow  and  has,  just  by  the  fact  that  you  have  enough  money  for  three  projects  and 

there  are  one  hundred  candidates,  a  low  a  priori  probability  of  success,  and  the  results  are  very,  very  slow 

in  coming.  The  experimental  device  research  is  very  expensive  and  very  risky.  So  again  you  have  to  use  your 
intuition  to  modify  these  a  priori  probabilities  and  hope  that  you  come  up  with  something  good.  But  I  really 
want  to  stand  up  for  doing  basic  device  research,  and  especially  as  Cardinal  (Warde)  said,  a  lot  of  questions 
on  the  interaction  of  light  and  matter  are  just  unknown  and  unanswered. 

C:  I  would  like  to  put  in  a  plu<-  also  for  materials  research.  I  feel  kind  of  naked  in  the  stuff  I  do,  like 

building  castles  in  the  sky,  and  >  ii  t  makes  them  eventually  touch  ground  is  the  materials  thing.  And  I  feel 
kind  of  frustrated  because  they  are  doing  research  in  a  certain  area  and  they  have  no  idea  of  whet  other 

areas  to  go  into.  You  can't  really  start  another  area  because  you  don't  have  the  devices  that  will  support 

it.  But  I  think  this  cycle  has  to  be  broken  in  either  of  two  ways.  One  is  that  the  systems  people  really 
have  to  stick  themselves  out  and  fantasize  what  Is  needed  and  then  the  device  people  can  move  in  that  direc¬ 
tion.  Or  also  the  device  people  can  say,  "Look,  here  are  these  unique  phenomena,"  and  find  some  way  for  using 


1AB 


r 


^ _ JL  — . 


ic.  But  I  chink  a  loc  of  this  cycle  is  determined  by  inertia  and,  like  Che  Hughes  liquid  crystal  light  valve, 
it  is  being  driven  by  TV  projection  criteria  and  averyone  is  tagging  along.  That  is  where  the  money  is  and 
chat  is  what  drives  it,  but  it  forces  the  rest  of  us  in  the  same  direction.  Vie  cried  to  look  at  the  problem 
independently  but  economics  always  drives  us  to  what  is  available.  [Alan  Huang] 

C:  In  conjunction  with  support  for  research  in  materials  and  devices,  I  endorse  that  it  is  needed.  But  I'd 

like  to  take  this  opportunity  to  address  a  question  that  was  raised  yesterday  by  Joe  Goodman  and  others,  i.e. 
how  can  we  induce  a  larger  change  in  the  index  of  refraction.  I  indicated  yesterday,  some  progress  has  been 
made  in  lithium  niobace  substrates  and  lithium  niobate  is  important  because  of  the  fact  it  has  good  electro* 
optical  and  acousto-opcical  properties.  I  indicated  that  an  employee  of  Bell  Labs  has  demonstrated  a  change 
of  index  of  refraction  of  0.13.  And  remember  that  the  index  of  refraction  of  lithium  niobate  is  2.2  and  that 
is  six  times  more  than  the  conventional  in-diffusion  and  I  think  that  is  important.  Another  characteristic, 
of  this  is  that  this  is  by  ion  exchange,  namely  exchanging  an  ion  of  lithium  with  silver  or  thorium.  This 
is  a  very  simple  process.  Whac  I  want  Co  add  co  chls  information  is  that  they  have  observed  that  with  this 
kind  of  ion  exchange  mechod,  the  index  profile  is  more  abrupt,  and  this  opens  up  the  possibilities  of  genera¬ 
ting  gradients  by  masks.  The  mask  they  use  is,  if  I  remember  correctly,  a  silicon  nitride  or  aluminum  mask. 

So  if  you  want  to  make  an  abrupt  gradient  profile  this  may  be  a  way;  but  I  think  chere  are  a  few  other  ways 
Co  go.  This  cype  of  research  is  important,  so  I  wanted  to  inform  you  on  this.  Mow  the  other  material, 
arsenic  trisulphide,  which  I  indicated  is  a  very  important  material  because  of  the  acousto-optic  figure  of 
meric,  is  one  hundred  times  better  than  lithium  niobate.  If  I  also  remember  correctly  there  is  some  research 
going  on  in  the  L’niversity  of  Pennsylvania.  I  remember  that  they  have  observed  this  effect;  after  arsenic 
trisulphide  is  deposited  on  sapphire  or  silicon,  if  you  expose  it  to  light,  at  what  wavelengths  I  don't  remem¬ 
ber,  you  can  generate  a  large  change  in  the  index  of  refraction.  So  these  are  two  cases  I  can  chink  of.  But 
as  they  say,  they  don't  know  what  the  mechanism  is.  So  I  can  think  of  two  very  potentially  useful  materials 
in  which  you  can  induce  large  changes  in  the  index  of  refraction.  This  type  of  research  is  important  and 
also  basic  interactions  are  important.  But  I  want  to  mention  one  thing.  You  people  are  familiar  with  the 
MSF-funded  submicron  fabrication  center,  now  instituted  at  Cornell.  SSF  has  supported  the  submicron  fabrica¬ 
tion  center  because  of  Che  fact  chat  the  cost  for  setting  up  equipment  and  facilities  Co  make  that  kind  of 
thing  is  so  expensive,  it  is  impossible  for  universities  co  do  this.  This  will  help  people  in  device  research 
co  have  the  device  fabricated  there.  So  this  brings  up  a  question;  in  optical  information  processing 
research,  i3  there  a  need  for  something  similar  to  this;  I  don't  mean  that  large  a  scale.  I  mean  in  a  small 
scale  that  can  be  established  by  maybe  ARO,  or  Air  Force  or  Joint  Services,  to  establish  a  facility  that  can 
fabricate  some  device  so  that  each  individual  university  does  not  have  to  repeat  those  things.  You  know  that 
ic  is  very  difficult,  as  a  modulator  is  very  expensive,  to  get  it  from  industry  even  if  industry  has  it.  But 
if  the  Joint  Services  can  bring  up  some  money  to  establish  some  useful  facility,  then  I  think  that  it  will 
serve  to  expedite  research  among  the  university  people.  And  I  don't  know  whether  there  is  such  a  need  for 
optical  information  processing.  [Chen  Tsai] 

JW:  It  is  a  very  interesting  question,  certainly.  While  we  are  on  the. subject  does  anybody  else  want  to 
comment  on  that?  I  think  what  he  Is  saying  is  that  some  of  us  who  are  applying  techniques  but  who  aren't 
tied  in  with  any  manufacturer  of  devices,  would  love  to  get  our  hands  on  some  things  so  that  we  can  more 
closely  relate  co  the  realtime  processing  that  the  sponsoring  people  keep  saying  they  want.  You  can  have  a 
technique  in  mind  but  if  you  don't  have  the  devices  it  is  pretty  cough  to  try  things  out. 

C:  I've  thought  for  some  time  now  chat  it  would  be  a  great  convenience  for  many  of  us  doing  optical  proces¬ 
sing  work  to  have  a  facility  available  to  us,  perhaps  by  correspondence,  to  generate  or  produce  exceptionally 

high  qualicy  computer  generated  optical  elements,  diffracting  elements,  maybe  binary,  maybe  phase  elements, 
maybe  gray  scale  elements.  There  is  a  whole  range  of  possibilities  and  there  is  a  range  of  technologies 
chat  have  not  been  exploited  coo  much.  [Bill  Rhodes] 

C:  This  Cornell  facility  might  prove  to  be  useful  if  they  are  really  user  oriented. 

SS;  I  don't  know  much  about  the  history  of  hov  the  Cornell  facility  was  developed.  But  if  it  does  what  it 

is  supposed  to  do  and  if  it  works  out,  if  the  management  can  be  worked  out,  I  think  it  will  be  a  very  useful 
resource.  I  can  see  a  lot  of  problems  in  managing  it,  like  wlio  is  going  to  determine  the  priorities,  who  is 
going  co  pay  for  how  it  runs  and  so  forth.  But  if  something  like  chat  could  be  established,  say  for  making 
opdcal  transducers,  that  would  be  a  very  welcome  resource. 

JW:  On  the  issue  of  computer  generated  masks,  I  think  the  most  impressive  facility  that  I  have  seen  is  Sing 
Lee's.  His  computer  controlled  scanners  that  he  uses  now  for  generating  binary  holograms  are  very  impressive, 
and  when  you  start  calking  about  wanting  to  multiplex  computer  generated  holograms,  it  is  almost  essential  co 
have  a  facility  like  that.  And  chey  are  rather  expensive  because  you  need  a  minicomputer,  you  need  the 
scanner,  etc. 

SS:  In  fact,  the  Integrated  circuit  people  at  Silicon  Valley  and  other  places  have  the  finest  mask  making 
capability,  buc  just  try  to  get  in  and  use  chem. 

JW:  Anybody  want  co  respond? 
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C:  I  would  like  co  make  a  comment  about  the  Cornell  submicron  facility.  The  concept  there  is,  by  design, 

not  really  a  job  shop.  It  is  a  place  where  you  can  go  and  do  research,  principally  a  research  place.  As  far 


as  specifying  something  and  expecting  them  to  do  it,  1  don't  think  that  will  work.  [Tom  Gaylord] 

SS:  Let  me  say  one  other  thing  about  this  practical  goal  of  how  do  we  get  a  light  valve  in  the  hands  of 
people  who  want  to  fool  around  with  them.  There  is  another  way  to  look  at  this  and  I  suppose  we  should  look 
at  the  lessons  of  the  Japanese.  They  have  very  strong  university-industry-government  cooperation  and  I  guess 
we  can  spend  hours  and  days  talking  about  how  they  evolved  to  this  state,  why  they  are  doing  it  and  how  they 
are  very  successful,  at  least  from  what  we  can  see.  But  1  think  we  need  to  move  in  this  direction,  and  in 
order  to  do  this  it  takes  some  very  creative  and  argumentative  salesmanship  with  the  people  in  industry  and  in 
our  specific  case  we  have  been  working  with  Hughes-Malibu  for  awhile.  We  try  to  get  light  valves  by  the 
cheapest  possible  techniques,  i.e.  borrow  them,  but  the  trouble  is  we  usually  wind  up  with  the  rejects  and 
they  are  constantly  obsessed  with  questions  of  patent  rights,  who  owns  this  and  what  if  we  invent  something, 
who  is  going  to  get  the  rights  and  all  such  things  like  this.  It  takes  a  lot  of  creative,  legal  argumentation 
to  try  to  convince  these  guys  that  we  are  really  in  the  same  boat  and  we  are  all  trying  to  work  toward  a  com¬ 
mon  goal.  So  if  somehow  this  could  be  expedited  by  talking  to  people  it  would  be  very  helpful. 

C:  There  is  currently  a  mechanism  in  the  Army  for  an  individual  in  the  university  to  go  to  an  Army  lab  and 

use  their  facilities.  I  tried  for  two  years  to  get  graduate  students  into  my  lab  down  in  Huntsville,  but  T 
was  unsuccessful,  because  no  faculty  member  wants  to  release  his  graduate  students  from  under  his  control  for 
that  length  of  time;  1  had  three  liquid  crystal  light  valves,  they  are  still  down  there,  they  run  every  day, 
they  are  available  to  anyone  who  wants  to  use  them  and  1  am  sure  those  guys  will  welcome  you  to  their  labora¬ 
tories;  but  you  have  to  leave  home.  [Bob  Guenther] 

JW:  That's  part  of  the  problem.  How  about  loaning  them  to  the  labs,  to  the  universities,  that  is  where  the 
people  are? 

C:  No  question  that  that  was  the  major  problem,  to  get  the  graduate  students  to  come  down  to  work  for  a- 

while.  [Bob  Guenther] 

HW:  Government  laboratories  can  make  equipment  available  to  universities  but  the  problem  is  that  government 
laboratories  have  to  purchase  it  from  someplace  and  ultimately  in  Washington  it  has  to  be  paid  for.  But  for 
equipment  which  is  going  to  be  used  or  has  been  used  to  evaluate  development  systems,  when  the  evaluation  is 
completed,  government  ownership  is  maintained  in  the  material.  This  material  can  then  be  transferred  to 
universities,  often  on  what  amounts  to  indefinite  loan,  which  is  for  all  practical  purposes  equivalent  to  a 
gift.  This  is  the  way  that  very  expensive  pieces  of  equipment  can  be  obtained,  usually  a  year  or  so  after 
they  were  available  in  industry.  So  you  either  get  current  lower  quality  equipment  or,  with  the  time  delay, 
you  can  get  the  expensive  equipment. 

JW:  One  thing  I  hear  Sandy  saying  is  that  there  Is  a  need  for  more  cooperation,  which  the  Japanese  apparently 
are  real  good  at,  and  sometimes  we  are  not  real  good  at. 

C:  I  would  like  to  address  the  general  sensor  question  along  that  same  line.  If  you  look  at  what  happens 

with  industry  in  the  United  States,  they  feel  that  it  is  important  to  their  Industrial  edge  that  they  develop 
a  group  that  la  large  enough  so  that  they  have  a  few  people  doing  sensor  work.  Now,  if  the  company  is  lucky 
enough,  perhaps  it  has  gifted  enough  people,  to  get  a  certain  edge  in  sensors,  I  think  that  it  is  unrealistic 
to  expect  that  a  university  group  should  get  first  cut  on  that  kind  of  a  device.  It  is  fairly  obvious,  I 
think,  that  the  main  purpose  of  a  meeting  like  thi*  is  that  we  meet  some  very  outstanding  people  that  are 
right  at  the  leading  edge  of  the  device  work  right  now.  So  we  can  go  and  talk  to  them  and  we  can  talk  about 
how  to  get  their  devices,  what  their  potentials  are,  and  so  on.  There  are  a  few  university  groups,  and  I'll 
advertise  the  Institute  of  Optics.  One  advantage  of  the  Institute  of  Optics  is  that  we  are  a  large  enough 

group  that  we  can  afford  a  person  or  so  in  one  area  and  another  person  in  another  area,  but  even  that  I  don't 

think  is  an  answer.  I  don't  think  the  government  user  facilities  are  an  obvious  end  all,  because  one  year, 
as  we  have  aeen  through  the  past  six  or  eight,  one  year  it  will  be  one  device,  and  then  another  year  there 
will  be  another  one.  Those  things  are  changing,  ao  if  you  try  to  grab  the  one  today  and  say  what  it's  going 
to  be  In  five  years,  that  la  very  touchy.  The  government  labs  build  up  a  very  elaborate  facility,  very,  very, 

first  class.  I  think  it  is  naive  to  expect  than  to  lend  their  liquid  crystal  vhlch  might  be  the  heart  of  a 

200,000  dollar  installation.  I  have  got  a  couple  of  nice  installations  in  my  lab  if  anyone  wants  the  key. 

[Nick  George] 

C;  It  cost  us  a  million  and  a  half  for  a  simple  installation  and  a  quarter  of  a  million  just  to  do  tome 
simple  dielectric  work  on  the  FROM. 

C:  I  waa  trying  to  level  down  in  case  the  press  was  hers.  But  if  someone  vents  to  come  and  work  in  my  lab 

that  la  fine.  If  they  want  to  borrow  a  piece  on  a  long  term  thing  and  tha  students  put  their  fingers  on  it, 

never  mind,  I  am  not  Interested.  I  think  it  la  a  good  offar.  [Nick  George] 

C:  1  would  like  to  address  the  problem  of  getting  spatial  light  modulators  into  the  hands  of  the  users, 

the  systems  people.  In  developing  the  mlcrochannel  spatial  light  modulator  for  example,  we  had  lota  of  dlffl- 
cultlss  in  trying  to  get  a  United  Stetea  company  to  package  the  image  lntenslfler  part  of  it.  We’d  give  them 
the  crystal  and  mlcrochannel  plate  and  ask  them  just  to  package  it  ao  that  ve  could  employ  e  visible  photo 
cathode,  because  as  you  know  the  bialkallne  metals  and  trlalkaline  photocathodea  decompose  on  exposure  to 
air.  So  they  have  to  be  vacuum  tight  and  they  have  to  be  seeled  off.  We  wanted  to  teat  sensitivity  to  see 
if  the  design  was  really  viable.  We  got  quotations  from  companies  for  just  the  packaging  like  $20,000  to 


$30,000  because  we  wanced  only  one.  [Cardinal  WardeJ 
R:  That  Is  very  cheap. 

C:  Not  if  you  have  a  $50,000  budget:  So  ve  got  frustrated,  we  tried  for  almost  a  year  to  get  United  States 

companies  Co  do  it.  These  were  companies  like  ITT,  Varian,  PMR.  They  all  have  the  facilities  to  do  that. 
Finally  ac  one  of  the  SPIE  meetings  I  walked  into  one  of  the  demonstration  booths  and  ran  across  Hamamatsu 
Corporation;  they  had  intensifier  tubes  and  chey  were  all  excited.  They  said,  "We  don't  understand  how  the 
device  works,  but  it  is  the  technology  we  are  interested  in,"  and  I  started  calling  their  managers  here  and 
in  Japan  and  I  finally  got  chem  to  agree  upon  a  price.  The  first  price  was  like  the  American  companies, 
that  is,  $10,000.  Then  I  said,  "Listen,  my  budget  has  only  5,000  dollars  for  this  kind  of  work,"  and  they 
said,  "Oh,  we  are  still  interested  though.  I'll  cell  you  what  we’ll  do,  we'll  do  it  on  a  best  effort  basis; 
we'll  put  some  of  our  development  money  into  it."  And  they  did.  They  built  the  first  device  for  us.  They 
charged  $5,000  and  the  thing  worked,  much  to  our  dismay.  Ue  expected  chat  they  didn't  know  what  we  were 
doing,  they  didn't  even  test  it.  They  built  it  and  the  president  of  their  company  put  it  in  his  pocket  and 
shipped  it  all  the  way  from  Japan.  They  are  now  so  interested  in  the  device  that  they  have  decided  to  try 
and  build  it  commercially  and  it  may  be  that  in  the  next  year  or  two  you  might  be  able  to  buy  one,  but  un¬ 
fortunately  it  is  going  to  say,  "Made  in  Japan"  instead  of  "Made  in  United  States.”  The  problem  is  that  chey 
don't  really  know  how  to  build  the  device;  if  you  want  a  device  with  high  spatial  resolution,  high  sensi¬ 
tivity,  you  probably  have  to  work  through  me  initially  until  they  know  what  they  are  doing.  They  are  just 
production  engineers  and  they  don't  now  have  the  ability  to  test  the  device.  [Cardinal  Wardt] 

C:  This  interaction  between  the  universities  and  industries  has  been  identified  as  a  major  problem  in  the 

USA  and  identified  as  something  that  DOt>  would  like  to  see  improved,  but  we  don't  have  any  solution,  except 
chat  we  would  look  favourably  on  this  type  of  interaction.  But  I  don't  know  how  we  generate  this  type  of 
interaction.  [Bob  Guenther] 

SS:  At  this  point  it  has  to  be  money. 

R:  Xo,  it  is  noc  money,  it  is  definitely  not  money.  [Bob  Guenther] 

C:  1  would  like  to  add  one  more  consent.  For  those  of  you  who  are  Interested  in  acquiring  a  micro-channel 

spatial  light  modulator  for  use  in  the  laboratories,  where  you  can  tolerate  the  fact  that  you  might  not  have 
an  optimum  device,  it  turns  out  that  the  device  Is  not  reslly  hard  to  fabricate  In  the  laboratory.  After  all 
we  can  do  it,  and  if  you  can  live  with  low  sensitivity,  1  shouldn't  even  say  low  sensitivity,  because  the 
sensitivity,  even  with  excellent  photo  cathode  is  much  better  chan  other  devices,  you  can  get  in  contact 
with  me  and  I  can  show  you  how  to  build  it  on  your  optical  bench.  You  can  store  information  for  two  weeks 
if  you  wanted  to  and  you  can  cycle  at  20Hz  as  we  presently  do.  This  is  the  sort  of  thing  a  graduate  student 
with  some  assistance  could  do;  so  don't  rule  out  the  possibility,  at  least  In  my  case,  for  interaction;  be¬ 
cause  we  are  all  in  this  together.  [Cardinal  Wards] 

JW:  the  last  line  was  "we  are  all  in  this  together,"  and  I  think  maybe  we  have  to  have  a  greater  appreciation 
of  that. 

SS:  I  am  in  the  university  and  if  I  wanted  to  talk  to  an  induscry  about  doing  something  cooperatively,  at 
first  they  will  say,  "Go  away,  we  know  all  the  answers,  we  don't  need  you  guys."  But  if  I  can  go  in  and  tell 
them  about  some  applications  for  an  existing  device  that  they  have  not  thought  of,  and  sell  them  and  show 
chem  chat  these  things  that  they  have  sitting  in  their  drawers,  gathering  dust,  could  be  used  for  something 
new  and  useful,  eventually  you  will  find  someone  who  will  listen,  and  you  just  have  to  do  an  intensive  sales 
job.  And  I  think  that  is  about  the  only  way  to  do  it.  Just  as  Cardinal  (Warde)  said,  you  have  to  search 
around  and  find  the  right  person  and  then  get  them  one  on  one  and  convince  them  thac  it  is  to  their  advantage 
to  ultimately  listen  to  you  and  maybe  he  will  let  you  borrow  some  of  these  devices  out  of  his  drawer. 

JG:  I  should  mention  chat  XSF  has  had,  1  don't  know  for  quite  how  long,  a  joint  industry-university  program 
in  which  at  least  up  till  recently  they  would  provide  funding  to  both  organizations,  usually  through  a  sub¬ 
contract  through  the  university;  but  as  of  two  or  three  weeks  ago  I  was  led  to  believe  that  the  monetary  con¬ 
tributions  from  h'SF  to  Che  industry  have  now  vanished  and  Industry  must  now  foot  the  bill  for  their  part  of 
the  program  and  chat  may  diminish  the  interest  in  the  program. 

C:  Wouldn't  they  complain  about  patent  rights  and  stuff  like  that?  I  work  in  Sandia  laboratories  which  is 

managed  by  private  industry  but  everything  in  it  is  owned  by  the  government.  But  you  know,  we  can  offer 
real  Live  money  and  you  can't  talk  to  these  guys  because  of  patent  rights,  etc.  They're  afraid  someone  is 
going  to  steal  their  super  idea  and  make  a  million  bucks  on  it.  [Terry  Stalker] 

C:  I  chink  universities  should  have  a  different  philosophy.  I  think  universities  should  work  on  the  basis 

of  whatever  we  can  get  although  we  probably  have  a  lower  budget.  But  we  should  have  to  stretch  the  budget  to 
do  things  better,  probably  not  in  direct  competition  with  induscry.  There  is  no  way  we  can  compete  with  in¬ 
dustry  or  government.  It  is  probably  fortunate  chat  we  don't  have  so  much  good  equipment  and  we  can  probably 
do  things  which  are  different  and  which  can  get  neat  results.  [H.  K.  Liu] 

C:  You  have  to  be  inventive,  there  Is  no  question  about  thac.  There  is  such  a  big  deal  about  the  national 

rood,  how  to  get  the  most  benefit  for  the  nation  in  research  or  whatever,  but  I  think  vou  still  have  to  argue 
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that  basically  if  someone  has  a  very  good  idea  and  is  willing  to  implement  it,  they  should  have  access  to  the 
equipment  necessary.  That  does  not  mean  you  should  be  in  competition  with  industry,  but  to  hand  a  guy  a 
light  valve  because  he  doesn't  have  50,000  dollars,  to  make  a  pool  of  money  available  and  get  twenty  light 
valves,  and  ten  to  circulate  and  get  chewed  up  in  the  universities,  or  something  like  that,  that  is  not 
really  unreasonable.  [Terry  Stalker] 

C:  If  you  don't  have  a  light  valve,  maybe  you  have  to  be  forced  to  look  at  the  major  literature  to  see  if 

the  devices  are  available  or  materials  are  available  to  build  your  own.  [K.  K.  Liu] 

JW:  I  think  this  is  a  good  point.  In  many  cases  it  is  the  government  labs  that  have  the  equipment  and  some¬ 
thing  that  1  have  realized  more  lately  is  that  they  have  a  shortage  of  people  because  of  some  hiring  freeze, 

etc;  so  obviously  there  is  a  need  for  more  interaction  between  universities  and  government  labs. 

C:  Even  if  a  center  was  established,  much  like  NSF  has  been  establishing  its  regional  facilities;  vou  still 

have  to  leave  your  lab  unless  you  were  lucky  enough  to  get  it.  And  that  is,  in  fact,  what  is  wrong  with  the 

regional  NSF  user  facilities,  the  guys  who  got  them  are  in  great  shape.  The  guys  who  didn't  get  them  hate 

then.  [Bob  Guenther] 

HW:  We  can  take  students  to  work  part  time  in  the  government  laboratories,  but  you  say  that  separates  the 
students  from  the  professor.  We  also  have  appointments  which  allow  a  professor  to  come  to  the  government 
labs  for  three  months  during  the  normal  summer  break  of  the  universities.  Thus  the  student  can  be  there 
part-time  and  the  professor  can  be  there  for  three  months.  For  independent  graduate  students  this  may  be  a 
workable  arrangement. 

C:  1  hate  to  bring  this  one  up.  There  is  actually  an  even  more  formal  arrangement  called  an  1PA  and  you 
can  go  for  two  years.  There  are  plenty  of  mechanisms  for  faculty  members  to  interact  with  the  government; 
graduate  students  to  interact  with  the  government;  for  industry  members  to  interact  with  the  government  at 
the  government  labs  and  actually  get  paid.  [Bob  Guenther] 

JW:  Part  of  the  problem  here  is  that,  in  my  experience,  the  way  the  universities  work,  the  way  the  promotion 
and  tenure  system  is  geared,  does  not  necessarily  encourage  people  to  go  off  and  spend  time  in  the  laborator¬ 
ies  when  they  should,  in  theory,  be  at  home  developing  their  own  programs. 

The  workshop  attendees  discussed  the  need  for  this  type  of  workshop  and  how  potential  future  workshops 
could  be  set  up.  It  was  voted  to  hold  similar  workshops  every  two  years,  alternating  with  the  Gordon  Research 
Conference,  beginning  in  1983.  Details  of  organizers,  sponsors,  and  location  were  left  open. 
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